-- Logs begin at Mon 2021-11-22 22:19:23 UTC, end at Mon 2021-11-22 23:21:11 UTC. -- Nov 22 22:50:38.526852 dv-cinder-818834-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 22:50:38.536525 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 22:50:38 2021] *** Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: nodename: dv-cinder-818834-1-iscsi Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: machine: x86_64 Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: clock source: unix Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: pcre jit disabled Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: detected number of CPU cores: 4 Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: current working directory: / Nov 22 22:50:38.538529 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: detected binary path: /usr/bin/uwsgi-core Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: your processes number limit is 47680 Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: your memory page size is 4096 bytes Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: detected max file descriptor number: 2048 Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: lock engine: pthread robust mutexes Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: thunder lock: enabled Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 22:50:38.539265 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 22:50:38.583369 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: Python main interpreter initialized at 0x55bf4aaa89c0 Nov 22 22:50:38.583369 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: python threads support enabled Nov 22 22:50:38.583369 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: your server socket listen backlog is limited to 100 connections Nov 22 22:50:38.583369 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: your mercy for graceful operations on workers is 90 seconds Nov 22 22:50:38.583723 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 22:50:38.583812 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: *** Operational MODE: preforking *** Nov 22 22:50:38.584037 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: *** uWSGI is running in multiple interpreter mode *** Nov 22 22:50:38.584037 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: spawned uWSGI master process (pid: 101935) Nov 22 22:50:38.584237 dv-cinder-818834-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 22:50:38.585590 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: spawned uWSGI worker 1 (pid: 101936, cores: 1) Nov 22 22:50:38.585590 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: spawned uWSGI worker 2 (pid: 101937, cores: 1) Nov 22 22:50:38.585590 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 22:50:40.188667 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:50:40.188667 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: from cryptography.utils import int_from_bytes Nov 22 22:50:40.189347 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:50:40.189347 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: from cryptography.utils import int_from_bytes Nov 22 22:50:40.201747 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:50:40.201747 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: from cryptography.utils import int_from_bytes Nov 22 22:50:40.202295 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:50:40.202295 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: from cryptography.utils import int_from_bytes Nov 22 22:50:42.754145 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 22:50:42.754692 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 22:50:42.754887 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 22:50:42.755245 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 22:50:42.755500 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 22:50:42.755897 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.756223 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.756547 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.756871 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.757201 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.757514 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.757876 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.758864 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.759200 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.759465 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.759783 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.760112 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818834-1-iscsi {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.760437 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.760748 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.761060 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.761381 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.761721 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.762047 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.762357 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.762861 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.763312 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.763627 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.763942 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.764279 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.764594 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.764907 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.765492 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.765595 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.765907 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.766223 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.766603 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818834-1-iscsi {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.766919 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.767236 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.767554 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.767970 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.768284 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.768598 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.768927 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.769251 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.769566 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.769923 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.770245 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.770567 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.770889 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.771195 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.771504 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.771820 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.772161 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.772451 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.772761 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.773012 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.773322 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.773750 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.774124 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.774454 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.774710 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.774962 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.775285 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.775609 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.775921 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.776238 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.776550 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.776861 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.777173 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.777483 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.777817 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.778127 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.778451 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.778774 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.779104 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.779416 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.779739 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.780137 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.780394 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.780705 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.781045 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.781365 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.781710 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.782370 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.782370 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.782674 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.782981 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.783290 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.783613 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.783949 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.784256 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.784509 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.784814 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.785123 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.785445 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.785781 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.786094 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.786404 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.786709 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.787017 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.787326 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.787634 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.787943 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.788251 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.788559 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.788872 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.789223 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.789544 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.789907 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.790233 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.790545 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.790851 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.791158 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.791467 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.791791 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.792099 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.792409 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.792735 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.793043 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.793350 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.793691 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.794005 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.794313 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.794635 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.794941 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.795249 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.795567 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.795876 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.796183 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.796531 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.796796 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.797100 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.797406 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.797733 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.798041 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.798346 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.798666 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.798993 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.799305 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.799614 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.800175 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.800495 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.800831 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.801164 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.801507 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.801850 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.802184 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.802518 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.802840 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.803156 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.803472 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.803801 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.804117 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.804427 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.804738 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.805576 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.805921 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.806256 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.806576 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.806895 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.807214 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.807529 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.807848 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.808178 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.808501 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.808816 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.809158 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.809507 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.809851 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.810181 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.810495 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.810819 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.811135 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.811450 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.811767 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.812100 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.812416 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.812731 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.813067 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.813387 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.813739 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.813739 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.813739 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.814703 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.814930 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.815238 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.815559 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.815886 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.816197 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.816532 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.816840 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.817154 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.817464 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.817795 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.818110 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.818423 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.818730 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.819054 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.819372 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.819680 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.820003 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.820310 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.821209 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.821527 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.821868 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.822184 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.822497 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.822821 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.823136 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.823450 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.823786 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.824120 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.824430 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.824757 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.825085 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.825405 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.825743 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.826057 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.826365 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.826672 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.826977 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.827291 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.827596 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.828253 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.828253 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.828507 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.828789 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.829111 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.829425 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.829786 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.830063 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.830366 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.830710 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.831016 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.831358 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.831699 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.832022 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.832350 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.832666 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.832984 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.833296 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.833631 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.833948 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.834262 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.834584 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.834898 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.835219 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.835531 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.835855 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.836239 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.836609 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.836920 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.837246 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.837587 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.837945 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.838185 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 22:50:42.838595 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.838694 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 22:50:42.838778 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.838867 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.838947 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 22:50:42.839190 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.839279 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 22:50:42.839501 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.839587 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 22:50:42.839814 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.839909 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.840126 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.840220 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.840438 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.840531 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.840759 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.840845 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.841070 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.841163 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.841392 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.841501 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.841722 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.841815 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.842048 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.842135 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.842359 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.842447 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.842681 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.842767 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.842990 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.843077 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.843308 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.843469 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818834-1-iscsi {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.843636 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.843790 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.843934 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.844069 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.844250 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.844394 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.844575 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.844717 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.844885 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.845034 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.845202 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.845347 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.845511 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.845687 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.845850 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.846045 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.846208 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.846350 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.846486 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.846656 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.846810 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.846952 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.847087 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.847375 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.847533 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.847685 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.847843 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.847998 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.848645 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.848776 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.848900 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.849020 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.849150 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.849150 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.849379 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.849499 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.849681 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.849821 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.849944 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818834-1-iscsi {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.850065 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.850184 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.850363 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.850489 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.850616 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.850745 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.850866 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.850993 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.851123 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.851245 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.851364 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.851485 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.851744 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.851912 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.852048 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.852441 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.852600 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.852820 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.852946 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.853158 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.853296 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.853487 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.853641 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.853839 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.853965 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.854168 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.854294 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.854483 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.854608 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.854796 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.854990 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.855123 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.855244 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.855414 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.855538 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.855723 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.855853 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.856052 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.856184 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.856304 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.856430 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.856574 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.856696 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.856901 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.857029 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.857227 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.857362 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.857539 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.857694 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.857823 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.857943 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.858064 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.858185 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.858373 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.858507 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.858699 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.858832 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.859012 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.859137 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.859326 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.859481 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.859637 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.859762 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.859948 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.860074 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.860262 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.860388 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.860574 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.860831 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.860957 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.861167 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.861300 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.861485 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.861628 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.861832 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.861953 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.862151 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.862254 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.862463 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.862557 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.862788 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.862875 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.863114 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.863202 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.863448 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.863637 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.863727 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.863807 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.864030 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.864110 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.864342 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.864506 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.864644 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.864779 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.864948 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.865093 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.865256 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.865407 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.865555 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.865728 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.865876 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.866012 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.866178 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.866321 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.866483 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.866634 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.869263 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.869413 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.869548 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.869706 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.869869 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.870012 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.870145 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.870281 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.870404 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.870525 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.870646 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.870646 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.870881 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.871003 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.871123 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.871243 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.871363 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.871504 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.871642 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.871764 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.871900 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.872098 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.872232 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.872354 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.872492 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.872614 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.872736 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.872862 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.872984 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.873104 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.873254 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.873384 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.873513 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.873692 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.873852 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.873982 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.874111 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.874232 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.874352 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.874473 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.874594 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.874722 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.874846 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.874990 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.875114 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.875234 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.875361 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.875490 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.875612 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.875732 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.875854 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.875982 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.876104 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.876236 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.876364 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.876491 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.876641 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.876764 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.876886 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.877022 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.877152 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.877272 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.877453 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.877579 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.877800 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.877946 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.878114 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.878243 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.878428 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.878574 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.878750 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.878883 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.879058 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.879184 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.879368 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.879499 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.879681 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.879806 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.879987 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.880118 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.880292 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.880415 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.880597 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.880721 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.880904 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.881031 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.881210 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.881333 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.881515 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.881699 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.881835 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.881962 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.882144 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.882347 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.882438 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.882517 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.882762 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.882865 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.883655 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.883784 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.883966 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.884259 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.884412 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.884572 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.884699 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.884882 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.885009 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.885189 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.885323 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:50:42.885500 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.885647 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.885861 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.885989 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.886177 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.886304 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.886484 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.886619 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.886796 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.886921 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.887103 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.887230 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.887410 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.887549 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.887716 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.887916 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888061 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888192 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888319 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888451 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888607 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888732 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.888912 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.889037 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.889218 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.889351 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.889526 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.889695 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.889875 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890002 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890188 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890314 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890493 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890619 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890800 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.890925 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.891104 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.891276 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.891447 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.891598 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.891753 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.891925 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.892113 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.892260 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.892450 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.892577 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.892705 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.892880 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.893026 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.893227 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.893359 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.893574 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.893720 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.893922 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.894049 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.894253 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.894377 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.894570 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.894719 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.894877 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895002 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895189 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895316 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895496 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895621 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895802 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.895935 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.896124 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.896250 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.896436 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.896562 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.896748 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.896876 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.897071 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.897197 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.897395 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.897527 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.897740 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.897867 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.898047 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.898170 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.898358 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.898490 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.898727 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.898855 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.899085 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.899268 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.899395 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.899595 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.899721 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.899909 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900035 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900225 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900351 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900543 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900669 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900858 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.900990 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.901171 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.901305 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.901486 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.901706 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.901833 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.901954 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.902120 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.902255 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.902502 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.902638 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.902766 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.902888 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903048 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903188 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903359 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903490 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903664 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903789 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.903975 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.904110 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.904282 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.904408 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.904590 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.904714 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.904895 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.905019 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.905216 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.905341 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.905533 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.905675 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.905875 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906008 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906204 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906330 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906521 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906652 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906837 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.906962 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.907152 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.907285 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.907469 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.907594 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.907776 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.907903 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.908107 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.908230 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.908434 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.908572 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.908757 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.908881 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.909068 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.909192 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.909379 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.909511 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.909707 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.909834 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910018 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910145 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910327 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910461 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910635 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910758 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.910941 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911066 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911246 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911381 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911553 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911685 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911861 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.911991 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.912185 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.912307 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.912477 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.912685 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.912817 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.912939 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.913068 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.913190 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.913379 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.913574 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.913732 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.913911 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.914050 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.914749 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.914958 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.915091 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.915386 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.915516 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.915711 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.915843 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916015 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916140 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916330 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916462 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916640 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916772 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.916965 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.917090 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.917289 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.917422 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.917602 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.917747 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.917938 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.918070 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.918243 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.918376 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.918567 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.918699 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.918889 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919014 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919202 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919339 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919516 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919639 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919847 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.919973 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.920166 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.920298 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.920493 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.920624 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.920807 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.920936 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.921129 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.921256 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.921453 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.921575 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.921785 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.921912 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.922099 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.922232 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.922406 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.922532 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.922718 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.922840 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923043 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923155 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923348 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923448 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923660 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923766 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.923973 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.924071 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.924284 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.924382 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.924589 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.924695 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.925166 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.925308 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.925488 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.925665 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.925818 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.925956 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.926143 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.926269 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.926458 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.926576 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.926867 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927011 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927135 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927256 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927376 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927503 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927698 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.927825 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928007 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928133 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928368 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928494 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928622 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928745 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.928910 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.929042 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.929252 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.929379 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.929558 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.929707 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.930478 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.930612 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.930812 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.931127 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.931261 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.931442 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.931725 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.931877 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.932064 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.932198 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.932392 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.932517 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.932710 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.932914 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933039 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933167 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933325 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933450 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933672 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933803 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.933969 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.934108 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.934275 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.934402 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.934582 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.934708 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.934888 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935025 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935199 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935318 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935506 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935632 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935809 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.935936 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.936112 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.936237 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.936433 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.936563 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.936737 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.936870 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.937229 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.937373 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.937495 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.937634 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.937778 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.937909 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938031 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938158 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938279 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938405 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938595 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938723 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.938898 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.939023 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.939230 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.939365 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.939549 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.939674 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.939873 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940002 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940203 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940337 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940519 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940653 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940844 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.940970 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.941156 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.941292 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.941472 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.941595 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.941815 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.941940 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.942130 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.942263 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.942444 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.942575 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.942760 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.942906 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943102 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943297 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943422 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943542 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943668 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943789 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.943977 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.944104 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.944289 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.944420 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.944606 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.944822 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.944955 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.945153 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.945279 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.945491 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.945675 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.945907 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.946231 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.946400 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.946533 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.946742 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.946867 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.947069 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.947194 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.947397 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.947522 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.947725 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.947850 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.948040 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.948174 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.948372 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.948496 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.948698 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.948822 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949016 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949140 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949329 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949460 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949666 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949808 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.949981 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.950112 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.950292 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.950417 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.950609 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.950745 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.950921 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951046 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951235 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951360 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951548 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951681 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951863 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.951989 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.952173 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.952299 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.952482 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.952613 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.952795 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.952918 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.953113 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.953303 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.953441 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.953570 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.953721 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.953842 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954033 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954167 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954342 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954478 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954654 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954776 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.954971 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.955095 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.955283 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.955417 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.955593 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.955724 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.955904 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956033 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956220 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956351 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956534 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956659 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956850 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.956980 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.957193 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.957365 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.957540 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.957693 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.957879 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.958035 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.958190 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.958365 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.958520 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.958693 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.958816 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959014 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959146 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959334 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959458 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959663 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959794 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.959972 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.960111 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.960282 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.960414 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.960601 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.960725 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.960914 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.961069 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.961326 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.961477 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.961715 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.961956 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.962098 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.962280 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.962405 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.962601 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.962733 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.962915 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.963068 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.963237 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.963459 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.963594 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.963807 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.963935 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.964128 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.964253 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.964447 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.964565 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.964762 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.964895 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.965072 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.965197 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.965381 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.965505 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.965707 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.965833 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966031 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966168 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966341 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966465 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966648 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966772 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.966960 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.967099 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.967267 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.967398 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.967575 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.967707 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.967882 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968019 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968192 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968317 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968501 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968632 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968808 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.968940 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.969113 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.969237 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.969421 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.969543 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.969752 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.969880 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970059 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970185 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970367 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970493 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970684 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970817 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.970993 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.971118 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.971301 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.971425 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.971604 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.971729 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.971909 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972041 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972217 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972342 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972523 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972655 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972834 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.972958 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.973138 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.973270 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.973447 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.973567 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.973776 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.973876 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.974085 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.974194 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.974387 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.974484 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.974710 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.974797 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975014 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975112 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975324 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975463 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975631 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975749 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.975938 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.976075 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.976259 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.976389 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.976573 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.977220 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.977475 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.977669 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.977852 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.978164 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.978288 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.978497 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.978781 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.978907 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.979137 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.979267 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.979460 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.979585 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.979880 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980029 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980152 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980272 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980391 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980510 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980697 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.980823 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981017 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981141 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981330 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981468 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981660 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981799 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.981976 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.982107 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.982289 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.982422 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.982604 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.982729 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.982915 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983046 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983227 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983360 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983609 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983754 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983879 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.983999 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.984162 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.984299 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.984477 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.984603 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.984794 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.984920 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.985112 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.985237 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.985427 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.985552 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.985770 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.985899 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.986090 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.986218 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.986405 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.986538 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.986715 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.986839 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987032 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987156 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987326 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987460 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987639 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987763 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.987954 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.988081 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.988265 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.988394 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.988570 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.988702 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.988895 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989019 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989205 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989330 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989521 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989680 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989860 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.989993 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.990178 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.990304 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.990491 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.990624 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.990847 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.990972 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.991168 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.991301 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.991490 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.991644 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.991801 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.991927 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.992132 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.992283 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.993039 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.993196 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.993436 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.993763 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.993917 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.994097 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.994232 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.994402 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.994534 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.994713 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.994838 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995026 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995279 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995407 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995528 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995680 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995806 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.995997 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.996124 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.996322 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.996449 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.996637 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.996774 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.996962 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.997100 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.997273 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.997414 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.997584 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.997737 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.997918 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.998053 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.998236 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.998360 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.998546 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.998678 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.998876 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.999008 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.999187 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.999311 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.999733 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.999888 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:42.999888 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000121 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000246 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000457 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000585 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000715 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000837 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.000958 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.001119 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.001245 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.001448 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.001581 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.001783 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.001910 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.002111 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.002238 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.002432 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.002560 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.002755 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.002881 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.003071 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.003197 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.003383 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.003510 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.003715 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.003927 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004054 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004214 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004354 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004476 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004632 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004764 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.004947 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.005081 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.005264 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.005388 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.005581 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.005757 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.005938 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.006075 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.006268 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.006393 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.006597 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.006732 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.006925 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.007062 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.007272 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.007398 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.007583 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.007706 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.007918 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.008058 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.008272 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.008438 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.008619 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.008916 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.009087 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.009238 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.009402 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.009571 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.009710 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 22:50:43.009912 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.010235 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.010555 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.010872 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.011186 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.011498 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.011829 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.012141 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.012471 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.012793 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.013122 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.013450 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.013793 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.014124 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.014439 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.014750 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.015062 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.015371 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.015728 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.016035 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.016363 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.016698 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.017032 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.017350 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.017717 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.018049 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.018373 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.018696 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.019024 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.019336 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.019646 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.019961 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.020270 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.020585 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.020897 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.021210 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.021520 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.021853 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.022162 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.022488 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.022798 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.023126 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.023439 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.023947 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.024376 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.024690 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.025042 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.025355 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.025736 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.026063 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.026394 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.026728 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.027049 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.027380 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.027870 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.028344 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.028675 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.028999 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.029328 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.029675 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.030004 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.030329 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.030651 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.030975 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.031296 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.031862 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.032094 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.032186 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.032512 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.032833 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.033153 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.033489 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.033821 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.034144 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.034463 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.034781 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.035098 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.035434 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.035767 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.036098 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.036439 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.036763 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.037084 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.037404 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.037748 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.038163 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.038427 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.038743 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.039065 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.039940 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.040533 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.040953 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.041276 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.041601 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.041946 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.042266 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.042584 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.042904 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.043226 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.043559 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.043900 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.044224 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.044545 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.044865 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.045187 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.045746 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.046081 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.046428 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.046764 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.047098 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.047423 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.047747 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.048081 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.048394 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.048709 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.049025 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.049339 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.049667 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.050262 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.050578 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.050890 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.051216 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.051532 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.052069 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.052423 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.052745 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.053079 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.053410 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.053761 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.054077 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.054405 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.054720 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.055716 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.056238 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.056564 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.056879 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.057194 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.057514 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.057857 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.058170 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.058487 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.058800 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.059133 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.059447 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.059759 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.060071 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.060388 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.060699 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.061008 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.061318 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.061658 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.062031 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.062280 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.062596 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.062906 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.063222 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.063533 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.063846 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.064156 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.064485 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.064797 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.065108 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.065430 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.065771 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.066107 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.066426 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.066743 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.067093 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.067415 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.067953 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.068348 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.068679 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.069028 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.069374 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.069719 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.070036 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.070352 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.070904 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.071446 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.071772 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.072096 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.072417 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.072736 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.073056 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.073374 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.073719 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.074041 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.074363 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.074710 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.075038 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.075363 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.075684 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.076013 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.076330 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.076648 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.076966 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.077281 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.077630 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.077968 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.078290 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.078607 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.079040 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.079362 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.079686 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.080013 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.080330 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.080660 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.080991 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.081309 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.081650 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.081972 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.082308 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.082651 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.082986 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.083316 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.083629 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.083937 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.084249 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.084565 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.084899 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.085236 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.085556 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.085912 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.086431 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.086974 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.087304 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.087642 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.087976 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.088304 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.088624 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.088966 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.089287 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.089608 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.089952 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.090272 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.090591 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.090914 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.091246 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.091579 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.091894 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.092225 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.092550 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.092878 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.093201 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.093519 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.093951 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.094271 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.094594 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.094933 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.095229 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.095555 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.095877 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.096216 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.096548 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.096881 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.097214 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.097561 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.097908 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.098259 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.098594 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.098721 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.context [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76bf02e0-29a2-4545-b6a3-dd98a1461c4d(cell1) {{(pid=101937) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 22:50:43.098916 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.099235 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.099547 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:50:43.099797 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 22:50:43.103525 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_concurrency.lockutils [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:50:43.105260 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_concurrency.lockutils [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:50:43.106135 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_concurrency.lockutils [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:50:43.108147 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_concurrency.lockutils [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:50:43.119312 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.121104 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.126897 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_db.sqlalchemy.engines [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.194918 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.context [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76bf02e0-29a2-4545-b6a3-dd98a1461c4d(cell1) {{(pid=101936) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 22:50:43.199980 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:50:43.201606 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:50:43.202514 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:50:43.204545 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:50:43.218422 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_db.sqlalchemy.engines [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.220710 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_db.sqlalchemy.engines [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.379284 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.481982 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_db.sqlalchemy.engines [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:50:43.726881 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: WARNING keystonemiddleware.auth_token [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:50:43.733337 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: WARNING keystonemiddleware.auth_token [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:50:43.811206 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: WARNING keystonemiddleware.auth_token [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:50:43.818714 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: WARNING keystonemiddleware.auth_token [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:50:43.957021 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: WARNING keystonemiddleware.auth_token [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:50:43.962948 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: WARNING keystonemiddleware.auth_token [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:50:43.968262 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bf4aaa89c0 pid: 101937 (default app) Nov 22 22:50:43.970341 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:50:43.971520 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Nov 22 22:50:43.971932 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Mon Nov 22 22:50:43 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:50:44.048087 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: WARNING keystonemiddleware.auth_token [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:50:44.053489 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: WARNING keystonemiddleware.auth_token [None req-1e39163d-f60e-4146-93a4-88ba45216f13 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:50:44.059625 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf4aaa89c0 pid: 101936 (default app) Nov 22 22:52:06.353203 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:06.354233 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 22 22:52:06.354649 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:06.906840 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-b6bd917a-dae0-4a61-bcb5-b26a038effd8 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:06.936677 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-b6bd917a-dae0-4a61-bcb5-b26a038effd8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.574712 Nov 22 22:52:06.937419 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1291 bytes} [Mon Nov 22 22:52:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:09.284876 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:09.285929 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2c9d9665-8c1c-4d4d-be26-c03c2eaf16a6 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Nov 22 22:52:09.286416 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:09.356299 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-071ce149-5396-4c3b-a67c-04ffd162c316 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:09.374900 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:52:09.374900 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: warnings.warn(msg) Nov 22 22:52:09.405472 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-071ce149-5396-4c3b-a67c-04ffd162c316 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110971 Nov 22 22:52:09.406063 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:09 2021] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:09.768881 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-c5d49c51-951a-429d-8d81-7772652fd0d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:09.771707 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:52:09.771707 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: warnings.warn(msg) Nov 22 22:52:09.823986 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-c5d49c51-951a-429d-8d81-7772652fd0d4 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.409054 Nov 22 22:52:09.824723 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1335 bytes} [Mon Nov 22 22:52:09 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:12.136018 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-071ce149-5396-4c3b-a67c-04ffd162c316 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:12.137731 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-071ce149-5396-4c3b-a67c-04ffd162c316 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Nov 22 22:52:12.138572 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:12.259990 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-007303de-31ab-4024-842b-9950f2cfc814 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "ram": 512, "disk": 5, "name": "ds512M", "vcpus": 1}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:12.280155 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:52:12.280155 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: warnings.warn(msg) Nov 22 22:52:12.303807 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-007303de-31ab-4024-842b-9950f2cfc814 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151930 Nov 22 22:52:12.304871 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:12.318754 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-363fb6d0-3435-456c-a304-f77ab752b5f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:12.320704 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:52:12.320704 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: warnings.warn(msg) Nov 22 22:52:12.359373 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-363fb6d0-3435-456c-a304-f77ab752b5f9 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045391 Nov 22 22:52:12.360294 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1335 bytes} [Mon Nov 22 22:52:12 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:14.680327 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-007303de-31ab-4024-842b-9950f2cfc814 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:14.681267 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-007303de-31ab-4024-842b-9950f2cfc814 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Nov 22 22:52:14.682037 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:14.749597 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-97154ee3-ecfa-45d0-b0e9-5afc996d5b63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "disk": 10, "ram": 1024, "swap": 0, "rxtx_factor": 1.0}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:14.769145 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-97154ee3-ecfa-45d0-b0e9-5afc996d5b63 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080193 Nov 22 22:52:14.769876 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:14.781951 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-808c5907-c742-401c-8cc3-7c54cb5d84ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:14.805712 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-808c5907-c742-401c-8cc3-7c54cb5d84ea admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027196 Nov 22 22:52:14.806735 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1335 bytes} [Mon Nov 22 22:52:14 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:52:17.117268 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-97154ee3-ecfa-45d0-b0e9-5afc996d5b63 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:17.118232 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-97154ee3-ecfa-45d0-b0e9-5afc996d5b63 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Nov 22 22:52:17.118637 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:17.178592 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-ba1e70ae-264b-4953-abc6-09d480e4acda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "id": "d3", "ram": 2048}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:17.201961 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-ba1e70ae-264b-4953-abc6-09d480e4acda admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076619 Nov 22 22:52:17.202716 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:17.214667 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-00a3c6db-ab47-4554-9bc2-4aa04ca1ede1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:17.238093 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-00a3c6db-ab47-4554-9bc2-4aa04ca1ede1 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026988 Nov 22 22:52:17.238888 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1335 bytes} [Mon Nov 22 22:52:17 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:19.573987 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-ba1e70ae-264b-4953-abc6-09d480e4acda admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:19.575685 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-ba1e70ae-264b-4953-abc6-09d480e4acda admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Nov 22 22:52:19.576271 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:19.639692 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-305ba47d-6550-47a3-881c-ed9221fcd316 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:19.658031 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-305ba47d-6550-47a3-881c-ed9221fcd316 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075461 Nov 22 22:52:19.658783 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 22:52:19.671137 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-aa298660-dcd4-4d97-a440-4d8a9a86994e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:19.696487 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-aa298660-dcd4-4d97-a440-4d8a9a86994e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028777 Nov 22 22:52:19.697302 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1335 bytes} [Mon Nov 22 22:52:19 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:22.050934 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-305ba47d-6550-47a3-881c-ed9221fcd316 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:22.052536 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-305ba47d-6550-47a3-881c-ed9221fcd316 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 22 22:52:22.053055 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:22.119510 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-a7aff2de-39e0-4b7b-a150-c6ab6a67863c admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:22.144660 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-a7aff2de-39e0-4b7b-a150-c6ab6a67863c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084829 Nov 22 22:52:22.145214 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1291 bytes} [Mon Nov 22 22:52:22 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:52:24.686701 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-305ba47d-6550-47a3-881c-ed9221fcd316 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:24.687882 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-305ba47d-6550-47a3-881c-ed9221fcd316 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Nov 22 22:52:24.688307 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:24.748856 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-3d0bff3a-bf61-46a4-9103-f60834357e80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "id": "1", "disk": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:24.766970 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-3d0bff3a-bf61-46a4-9103-f60834357e80 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071945 Nov 22 22:52:24.767546 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:24 2021] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:24.780549 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-7f6c500b-0080-433f-84ea-1d9d7178918a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:24.808443 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-7f6c500b-0080-433f-84ea-1d9d7178918a admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031640 Nov 22 22:52:24.809161 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1332 bytes} [Mon Nov 22 22:52:24 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:52:27.106377 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-3d0bff3a-bf61-46a4-9103-f60834357e80 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:27.107316 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-3d0bff3a-bf61-46a4-9103-f60834357e80 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Nov 22 22:52:27.107922 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:27.172469 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-91ea9948-b1ee-40d9-a98b-a28e0a8ddc54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:27.192826 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-91ea9948-b1ee-40d9-a98b-a28e0a8ddc54 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078470 Nov 22 22:52:27.193536 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 22:52:27.206303 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-0ed9600a-e873-49c5-b4d5-da95064d8e05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:27.234161 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-0ed9600a-e873-49c5-b4d5-da95064d8e05 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031279 Nov 22 22:52:27.234781 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1332 bytes} [Mon Nov 22 22:52:27 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:29.556992 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-91ea9948-b1ee-40d9-a98b-a28e0a8ddc54 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:29.558062 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-91ea9948-b1ee-40d9-a98b-a28e0a8ddc54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Nov 22 22:52:29.558471 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:29.618144 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-5dc79e77-eae7-4c56-bbb4-eeb69ccfce0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:29.635853 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-5dc79e77-eae7-4c56-bbb4-eeb69ccfce0d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070963 Nov 22 22:52:29.636408 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:29 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:29.648572 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-7fb884da-5425-443a-b364-c45bea3d3570 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:29.673317 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-7fb884da-5425-443a-b364-c45bea3d3570 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027984 Nov 22 22:52:29.673946 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1332 bytes} [Mon Nov 22 22:52:29 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:32.009031 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-5dc79e77-eae7-4c56-bbb4-eeb69ccfce0d admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:32.010932 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-5dc79e77-eae7-4c56-bbb4-eeb69ccfce0d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004559 Nov 22 22:52:32.011456 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:32 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:32.101765 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-206fcd5a-8633-4548-a117-7e5357f2a690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "ram": 8192, "vcpus": 4}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:32.121384 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-206fcd5a-8633-4548-a117-7e5357f2a690 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091952 Nov 22 22:52:32.122062 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:32 2021] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:32.137075 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-3a0291dd-ae51-41d8-9658-6f7d1b59130a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:32.165271 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-3a0291dd-ae51-41d8-9658-6f7d1b59130a admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034298 Nov 22 22:52:32.166000 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1332 bytes} [Mon Nov 22 22:52:32 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:34.493581 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-206fcd5a-8633-4548-a117-7e5357f2a690 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:34.494619 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-206fcd5a-8633-4548-a117-7e5357f2a690 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 22 22:52:34.495042 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:34.561998 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-e060b33e-d345-47c5-89eb-b1d64d73e75d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:34.581204 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-e060b33e-d345-47c5-89eb-b1d64d73e75d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079818 Nov 22 22:52:34.590589 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1282 bytes} [Mon Nov 22 22:52:34 2021] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:52:34.595538 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-def4a5fa-5c16-4fb7-a638-f43bc6f4fe5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:52:34.620836 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-def4a5fa-5c16-4fb7-a638-f43bc6f4fe5a admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028812 Nov 22 22:52:34.621727 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1332 bytes} [Mon Nov 22 22:52:34 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:52:57.111514 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-e060b33e-d345-47c5-89eb-b1d64d73e75d admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:57.112438 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-e060b33e-d345-47c5-89eb-b1d64d73e75d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Nov 22 22:52:57.112838 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:52:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:57.170802 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-e67bca2a-ee59-4097-8624-5fd4513ee2c1 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:57.188109 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-e67bca2a-ee59-4097-8624-5fd4513ee2c1 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068374 Nov 22 22:52:57.188640 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1291 bytes} [Mon Nov 22 22:52:57 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:52:58.698674 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-e060b33e-d345-47c5-89eb-b1d64d73e75d admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:58.699673 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-e060b33e-d345-47c5-89eb-b1d64d73e75d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 22 22:52:58.700079 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:52:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:52:58.893255 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-1a56e1ac-bc45-40a7-b979-05c727d83b09 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:58.898873 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.wsgi [None req-1a56e1ac-bc45-40a7-b979-05c727d83b09 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 22:52:58.899450 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-1a56e1ac-bc45-40a7-b979-05c727d83b09 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:52:58.900228 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-1a56e1ac-bc45-40a7-b979-05c727d83b09 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060463 Nov 22 22:52:58.900742 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Nov 22 22:52:58 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 22:52:58.911382 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-a08aad65-6a07-488a-9d2c-0de9c2246d18 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:58.932450 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-a08aad65-6a07-488a-9d2c-0de9c2246d18 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025314 Nov 22 22:52:58.932998 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Nov 22 22:52:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:52:58.943788 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-1f97dcfa-62ea-49ba-b067-f12f1067af64 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:58.964545 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-1f97dcfa-62ea-49ba-b067-f12f1067af64 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024576 Nov 22 22:52:58.965078 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Nov 22 22:52:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:52:58.975656 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-05131e04-0c98-4b36-b8ee-35294e481606 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:52:58.981277 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.wsgi [None req-05131e04-0c98-4b36-b8ee-35294e481606 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 22:52:58.981918 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-05131e04-0c98-4b36-b8ee-35294e481606 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:52:58.982758 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-05131e04-0c98-4b36-b8ee-35294e481606 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011370 Nov 22 22:52:58.983255 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Nov 22 22:52:58 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 22:53:00.409593 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-1f97dcfa-62ea-49ba-b067-f12f1067af64 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:00.411105 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-1f97dcfa-62ea-49ba-b067-f12f1067af64 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001899 Nov 22 22:53:00.411549 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:00.610803 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-ae7b653a-b6ac-4841-91fd-50f88884593a admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:00.616859 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.wsgi [None req-ae7b653a-b6ac-4841-91fd-50f88884593a admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 22:53:00.617368 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-ae7b653a-b6ac-4841-91fd-50f88884593a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:53:00.618197 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-ae7b653a-b6ac-4841-91fd-50f88884593a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059387 Nov 22 22:53:00.618704 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Nov 22 22:53:00 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 22:53:00.628242 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-38af18d8-2992-4490-bb9c-50804b01d45b admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:00.642079 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-38af18d8-2992-4490-bb9c-50804b01d45b admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017260 Nov 22 22:53:00.642602 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Nov 22 22:53:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:53:00.652966 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-c344cc9b-b596-4003-8663-d26cd6057e85 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:00.666624 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-c344cc9b-b596-4003-8663-d26cd6057e85 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017070 Nov 22 22:53:00.667142 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Nov 22 22:53:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:53:00.677186 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-deed9325-e52c-4a11-88db-2e04b370cf93 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:00.682314 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.wsgi [None req-deed9325-e52c-4a11-88db-2e04b370cf93 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 22:53:00.682872 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-deed9325-e52c-4a11-88db-2e04b370cf93 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:53:00.683643 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-deed9325-e52c-4a11-88db-2e04b370cf93 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010229 Nov 22 22:53:00.684126 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Nov 22 22:53:00 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 22 22:53:02.071869 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-c344cc9b-b596-4003-8663-d26cd6057e85 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:02.072877 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-c344cc9b-b596-4003-8663-d26cd6057e85 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 22 22:53:02.073518 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:02.268111 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-4dfd6230-15ef-4399-af9e-567adeedf7e3 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:02.273770 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.wsgi [None req-4dfd6230-15ef-4399-af9e-567adeedf7e3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 22:53:02.274328 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-4dfd6230-15ef-4399-af9e-567adeedf7e3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:53:02.275115 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-4dfd6230-15ef-4399-af9e-567adeedf7e3 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058608 Nov 22 22:53:02.275621 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Nov 22 22:53:02 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 22:53:02.285571 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-cdea730a-0c03-4c07-a05e-4ac73a06a467 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:02.299589 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-cdea730a-0c03-4c07-a05e-4ac73a06a467 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017762 Nov 22 22:53:02.300156 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Nov 22 22:53:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:53:02.311121 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:02.326731 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019443 Nov 22 22:53:02.327281 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Nov 22 22:53:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:53:02.337295 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-f2d5714d-5572-495a-9985-e8f9d070fb7c admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:02.342679 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.wsgi [None req-f2d5714d-5572-495a-9985-e8f9d070fb7c admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 22:53:02.343222 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-f2d5714d-5572-495a-9985-e8f9d070fb7c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:53:02.343999 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-f2d5714d-5572-495a-9985-e8f9d070fb7c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010279 Nov 22 22:53:02.344489 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Nov 22 22:53:02 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 22:53:03.730962 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:03.731956 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 22 22:53:03.732347 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:03.926431 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-25661af5-0710-4239-a0e8-8b9b9116edb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:53:03.944166 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-25661af5-0710-4239-a0e8-8b9b9116edb0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070217 Nov 22 22:53:03.944660 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Nov 22 22:53:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:53:05.336956 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:05.337971 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Nov 22 22:53:05.338362 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:05.536898 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-6ebb84bf-3d06-4070-a42f-97ab8a381e97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:53:05.554357 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-6ebb84bf-3d06-4070-a42f-97ab8a381e97 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069421 Nov 22 22:53:05.554895 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Nov 22 22:53:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:53:06.956280 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:06.957907 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Nov 22 22:53:06.958293 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:07.152794 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-782ea3b8-9b23-40ba-8a97-c607e97d6139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:53:07.170768 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-782ea3b8-9b23-40ba-8a97-c607e97d6139 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069903 Nov 22 22:53:07.171307 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Nov 22 22:53:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:53:08.620083 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:08.621075 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 22 22:53:08.621472 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:08.814726 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-16bf5ddb-b100-4775-9a8d-7ba843a733f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:53:08.833287 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-16bf5ddb-b100-4775-9a8d-7ba843a733f0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069577 Nov 22 22:53:08.833806 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Nov 22 22:53:08 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:53:10.259721 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:10.260709 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Nov 22 22:53:10.261113 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:53:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:10.465269 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-1cad5c8a-e8d7-4350-8e71-b1831a24bf05 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:10.485170 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-1cad5c8a-e8d7-4350-8e71-b1831a24bf05 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073119 Nov 22 22:53:10.485744 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1202 bytes} [Mon Nov 22 22:53:10 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:53:57.669118 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:57.670132 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-12b149c8-8abd-40a9-b72b-fb099f7fa385 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 22 22:53:57.670529 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 31/63] 10.222.0.81 () {54 vars in 930 bytes} [Mon Nov 22 22:53:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:53:57.728466 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-beb877e2-f165-4cd6-937b-42c8bdd78a4f admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:57.747087 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-beb877e2-f165-4cd6-937b-42c8bdd78a4f admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069496 Nov 22 22:53:57.747893 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1291 bytes} [Mon Nov 22 22:53:57 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:53:57.770522 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-b235e164-24d2-465c-84da-7fc107a3c559 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:57.778210 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-b235e164-24d2-465c-84da-7fc107a3c559 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011882 Nov 22 22:53:57.778734 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1282 bytes} [Mon Nov 22 22:53:57 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:53:57.791380 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-ea0e8e63-bfd9-41a1-a261-10dd502a2ca0 admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:57.799681 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-ea0e8e63-bfd9-41a1-a261-10dd502a2ca0 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011823 Nov 22 22:53:57.800204 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 34/66] 10.222.0.81 () {60 vars in 1285 bytes} [Mon Nov 22 22:53:57 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:53:57.811881 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-fa2a8664-97f1-4dfc-a609-1f298caedb14 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:57.819584 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-fa2a8664-97f1-4dfc-a609-1f298caedb14 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011250 Nov 22 22:53:57.820094 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1285 bytes} [Mon Nov 22 22:53:57 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:53:57.832501 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:53:57.840256 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012135 Nov 22 22:53:57.840787 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 35/68] 10.222.0.81 () {60 vars in 1282 bytes} [Mon Nov 22 22:53:57 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:55:22.304148 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-c46b8a2c-c82b-4e12-bb78-f093774581cf tempest-verify_tempest_config-915493648 tempest-verify_tempest_config-915493648-project] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:55:22.306107 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-c46b8a2c-c82b-4e12-bb78-f093774581cf tempest-verify_tempest_config-915493648 tempest-verify_tempest_config-915493648-project] 10.222.0.81 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111872 Nov 22 22:55:22.306642 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 34/69] 10.222.0.81 () {58 vars in 1133 bytes} [Mon Nov 22 22:55:22 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:56:52.688478 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:56:52.689471 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 22 22:56:52.689903 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 36/70] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:56:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:56:52.945476 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-15aa8d77-0d5d-4afc-abcc-c08bd736b304 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:56:52.946637 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:56:52.946637 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: warnings.warn(msg) Nov 22 22:56:52.948138 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-15aa8d77-0d5d-4afc-abcc-c08bd736b304 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:56:52.948571 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-15aa8d77-0d5d-4afc-abcc-c08bd736b304 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:56:52.949404 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-15aa8d77-0d5d-4afc-abcc-c08bd736b304 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:56:52.949851 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-15aa8d77-0d5d-4afc-abcc-c08bd736b304 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:56:52.983053 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-15aa8d77-0d5d-4afc-abcc-c08bd736b304 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151160 Nov 22 22:56:52.983610 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 35/71] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Nov 22 22:56:52 2021] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:56:54.424892 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:56:54.425969 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 22 22:56:54.426374 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 37/72] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:56:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:56:54.618613 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-dbc04af7-31f5-402e-b433-6226abf475d1 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:56:54.619768 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:56:54.619768 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: warnings.warn(msg) Nov 22 22:56:54.621296 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-dbc04af7-31f5-402e-b433-6226abf475d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:56:54.621768 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-dbc04af7-31f5-402e-b433-6226abf475d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:56:54.622558 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-dbc04af7-31f5-402e-b433-6226abf475d1 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:56:54.623000 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-dbc04af7-31f5-402e-b433-6226abf475d1 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:56:54.642173 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-dbc04af7-31f5-402e-b433-6226abf475d1 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075790 Nov 22 22:56:54.642654 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 36/73] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Nov 22 22:56:54 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:57:06.467731 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:57:06.468748 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 22 22:57:06.469149 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 38/74] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:57:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:57:06.664973 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-1e98df55-2dc7-4f37-bfb2-b199324df865 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:57:06.666605 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:57:06.666605 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: warnings.warn(msg) Nov 22 22:57:06.668383 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e98df55-2dc7-4f37-bfb2-b199324df865 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:57:06.669086 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e98df55-2dc7-4f37-bfb2-b199324df865 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:57:06.669984 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e98df55-2dc7-4f37-bfb2-b199324df865 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:57:06.670412 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-1e98df55-2dc7-4f37-bfb2-b199324df865 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:57:06.695064 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-1e98df55-2dc7-4f37-bfb2-b199324df865 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083273 Nov 22 22:57:06.695549 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 37/75] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Nov 22 22:57:06 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:57:08.140633 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: DEBUG nova.api.openstack.wsgi [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] Calling method '>' {{(pid=101937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:57:08.141658 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: INFO nova.api.openstack.requestlog [None req-2029259d-2c1d-4519-b635-fcf09c88c9be admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 22 22:57:08.142070 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: [pid: 101937|app: 0|req: 39/76] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Nov 22 22:57:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:57:08.341930 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG nova.api.openstack.wsgi [None req-baf7db62-84f6-435b-a241-eebb11d50b24 admin admin] Calling method '>' {{(pid=101936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:57:08.343078 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:57:08.343078 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: warnings.warn(msg) Nov 22 22:57:08.344639 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-baf7db62-84f6-435b-a241-eebb11d50b24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:57:08.345076 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-baf7db62-84f6-435b-a241-eebb11d50b24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:57:08.345943 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-baf7db62-84f6-435b-a241-eebb11d50b24 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:57:08.346316 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: DEBUG oslo_concurrency.lockutils [None req-baf7db62-84f6-435b-a241-eebb11d50b24 admin admin] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:57:08.367575 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: INFO nova.api.openstack.requestlog [None req-baf7db62-84f6-435b-a241-eebb11d50b24 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083283 Nov 22 22:57:08.368129 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: [pid: 101936|app: 0|req: 38/77] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Nov 22 22:57:08 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:58:07.226517 dv-cinder-818834-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 22 22:58:07.227281 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: Mon Nov 22 22:58:07 2021 - graceful shutdown triggered... Nov 22 22:58:07.227779 dv-cinder-818834-1-iscsi devstack@n-api.service[101937]: Gracefully killing worker 2 (pid: 101937)... Nov 22 22:58:07.228189 dv-cinder-818834-1-iscsi devstack@n-api.service[101936]: Gracefully killing worker 1 (pid: 101936)... Nov 22 22:58:08.228558 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: worker 1 buried after 1 seconds Nov 22 22:58:08.228558 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: worker 2 buried after 1 seconds Nov 22 22:58:08.228558 dv-cinder-818834-1-iscsi devstack@n-api.service[101935]: goodbye to uWSGI. Nov 22 22:58:08.230148 dv-cinder-818834-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 22 22:58:08.230700 dv-cinder-818834-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 22 22:58:08.233519 dv-cinder-818834-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 22:58:08.244540 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 22:58:08.247752 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 22:58:08 2021] *** Nov 22 22:58:08.247965 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 22:58:08.248124 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 22:58:08.248260 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: nodename: dv-cinder-818834-1-iscsi Nov 22 22:58:08.248382 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: machine: x86_64 Nov 22 22:58:08.248494 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: clock source: unix Nov 22 22:58:08.248604 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: pcre jit disabled Nov 22 22:58:08.248730 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: detected number of CPU cores: 4 Nov 22 22:58:08.248847 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: current working directory: / Nov 22 22:58:08.248973 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: detected binary path: /usr/bin/uwsgi-core Nov 22 22:58:08.249106 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: your processes number limit is 47680 Nov 22 22:58:08.249223 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: your memory page size is 4096 bytes Nov 22 22:58:08.249334 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: detected max file descriptor number: 2048 Nov 22 22:58:08.249446 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: lock engine: pthread robust mutexes Nov 22 22:58:08.249913 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: thunder lock: enabled Nov 22 22:58:08.250378 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 22:58:08.250760 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 22:58:08.298655 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: Python main interpreter initialized at 0x55840a9d39c0 Nov 22 22:58:08.298655 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: python threads support enabled Nov 22 22:58:08.298655 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: your server socket listen backlog is limited to 100 connections Nov 22 22:58:08.298655 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: your mercy for graceful operations on workers is 90 seconds Nov 22 22:58:08.299073 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 22:58:08.299073 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: *** Operational MODE: preforking *** Nov 22 22:58:08.299296 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: *** uWSGI is running in multiple interpreter mode *** Nov 22 22:58:08.299296 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: spawned uWSGI master process (pid: 116325) Nov 22 22:58:08.299504 dv-cinder-818834-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 22:58:08.300187 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: spawned uWSGI worker 1 (pid: 116338, cores: 1) Nov 22 22:58:08.302502 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: spawned uWSGI worker 2 (pid: 116339, cores: 1) Nov 22 22:58:08.302502 dv-cinder-818834-1-iscsi devstack@n-api.service[116325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 22:58:10.129117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:58:10.129117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: from cryptography.utils import int_from_bytes Nov 22 22:58:10.129819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:58:10.129819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: from cryptography.utils import int_from_bytes Nov 22 22:58:10.146268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:58:10.146268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: from cryptography.utils import int_from_bytes Nov 22 22:58:10.146878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 22:58:10.146878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: from cryptography.utils import int_from_bytes Nov 22 22:58:12.468851 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 22:58:12.469450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 22:58:12.469548 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 22:58:12.469900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 22:58:12.470155 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 22:58:12.470551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.470885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.471215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.471539 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.471871 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.472188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.472520 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.472847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.473178 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.473445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.473793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.474123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818834-1-iscsi {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.474452 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.474774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.475086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.475412 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.475725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.476698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.476698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.476856 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.478792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.478792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.478792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.479090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.479417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.479736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.480065 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.480383 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.480716 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.481031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.481455 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818834-1-iscsi {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.481828 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.482136 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.482461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.482890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.483199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.483515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.483841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.484177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.484483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.484816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.485143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.485468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.485824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.486138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.486451 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.486764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.487090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.487595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.487922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.488183 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.488500 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.488841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.489167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.489496 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.489779 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.490082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.490451 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.490955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.491086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.491377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.491692 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.492006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.492324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.492636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.492949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.493263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.494234 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.494830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.495245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.495567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.495896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.496320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.496575 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.496894 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.497245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.497570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.497914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.498243 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.498573 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.498890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.499207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.499523 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.499849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.500190 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.500510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.500772 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.501079 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.501394 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.501906 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.502372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.502695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.503014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.503324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.503639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.503957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.504272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.504585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.504900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.505216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.505531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.505870 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.506186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.506511 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.506836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.507150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.507465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.507777 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.508090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.508415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.508728 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.509040 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.509467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.509989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.510315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.510646 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.510966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.511281 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.511606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.511916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.512230 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.512559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.512890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.513887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.513887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.513887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.514368 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.514527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.514741 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.515066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.515371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.515697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.516027 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.516346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.516658 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.516971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.517295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.517657 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.517998 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.518344 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.518661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.518996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.519333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.519655 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.519967 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.520298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.520633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.520968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.521284 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.521641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.521978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.522296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.522644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.522968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.523306 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.523633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.523950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.524285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.524635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.525533 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.525930 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.526313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.526630 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.526950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.527405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.527600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.527932 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.528255 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.528615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.528897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.529242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.529563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.529913 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.530252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.530581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.530903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.531219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.531529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.531840 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.532162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.532474 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.532805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.533136 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.533449 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.533891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.534201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.534517 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.534834 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.535143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.535461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.535776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.536087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.536414 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.536730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.537041 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.537369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.537702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.538016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.538335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.538653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.538968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.539287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.539630 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.539957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.540271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.540676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.541024 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.541339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.541687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.542022 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.542347 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.542914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.543229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.543873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.543873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.544172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.544444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.544921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.545231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.545595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.545868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.546180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.546508 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.546828 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.547142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.547459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.547780 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.548111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.548424 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.548775 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.549112 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.549442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.549798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.550119 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.550445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.550765 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.551087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.551408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.551727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.552055 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.552375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.552705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.553030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.553360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.553700 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.554032 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.554343 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.554668 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.555017 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.555356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.555682 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.556551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.556928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.557255 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.557581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.557922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.558242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.558562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.558890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.559211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.559535 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.559854 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.560183 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.560499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.560825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.561138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.561458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.561819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.562159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.562478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.562799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.563129 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.563453 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.563770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.564088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.564400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.564717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.565035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.565353 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.565714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.566015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.566326 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.566649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.566961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.567271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.567581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.567899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.568241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.569158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.569158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.569346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.569540 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.569845 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.570179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.570499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.570806 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.571115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.571425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.572370 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.572707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.572954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.573259 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.573664 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.573926 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.574239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.574557 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.574875 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.575200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.575549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.575829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.576168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.576489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.576619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 22:58:12.577050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 22:58:12.577148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.577148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.577333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 22:58:12.577428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.577724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 22:58:12.577822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.577989 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 22:58:12.578093 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.578378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.578476 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.578700 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.578798 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.579017 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.579114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.579341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.579444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.579710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.579925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.580021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.580265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.580355 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.580590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.580719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.580915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.581100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.581257 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.581372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.581592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.581737 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.581949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.582171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818834-1-iscsi {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.582297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.582557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.582639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.582875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.582974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.583202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.583292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.583531 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.583628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.583847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.583936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.584164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.584254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.584474 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.584564 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.584784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.585044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.585159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.585596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.585746 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.585746 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.586122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.586122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.586275 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.586388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.586487 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.586698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.587034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.587378 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.587582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.587794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.587895 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.588161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.588492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.588630 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.588815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.588905 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.589126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.589223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.589448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.589529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.589789 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.590004 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818834-1-iscsi {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.590138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.590338 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.590448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.590664 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.590792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.590991 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.591127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.591416 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.591516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.591740 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.591836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.592060 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.592176 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.592390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.592479 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.592700 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.592791 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.593009 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.593184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.593322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.593412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.593704 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.593799 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.593974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.594076 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.594285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.594383 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.594604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.594695 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.594922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.595013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.595238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.595333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.595553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.595649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.595862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.595952 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.596178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.596296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.596442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.596544 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.596758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.596857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.597112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.597218 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.597410 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.597499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.597742 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.597849 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.598016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.598115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.598274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.598380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.598600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.598698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.598927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.599018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.599244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.599347 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.599560 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.599651 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.599866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.599962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.600176 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.600267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.600484 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.600581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.600797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.600899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.601110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.601203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.601422 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.601512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.601771 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.601874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.602090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.602182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.602399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.602496 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.602711 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.602801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.603056 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.603139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.603374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.603686 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.603774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.603999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.604088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.604327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.604418 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.604645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.604742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.604955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.605053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.605271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.605369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.605579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.605703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.605919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.606113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.606245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.606560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.606867 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.607160 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.607278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.607481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.607587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.607781 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.607877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.608090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.608199 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.608416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.608513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.608730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.608827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.609012 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.609142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.609336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.609608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.609805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.609996 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.610105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.610327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.610431 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.610622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.610780 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.610940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.611105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.611259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.611420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.611573 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.611736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.611872 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.612054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.612163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.612371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.612466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.612692 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.612797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.613000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.613092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.613326 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.613426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.613682 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.613783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.614001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.614088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.614315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.614403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.614848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.614962 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.615049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.615131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.615267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.615366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.615582 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.615674 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.615897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.615998 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.616212 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.616303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.616539 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.616641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.616847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.616947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.617160 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.617249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.617474 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.617562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.617821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.618004 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.618148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.618328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.619018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.619308 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.619460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.619628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.619922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.620023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.620245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.620345 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.620561 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.620652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.620875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.620963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.621190 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.621285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.621508 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.621606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.621843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.622007 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.622157 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.622253 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.622474 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.622565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.622782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.622877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.623095 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.623196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.623409 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.623505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.623722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.623811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.624028 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.624125 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.624334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.624468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.624663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.624787 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.624998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.625099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.625318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.625403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.625652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.625745 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.625975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.626079 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.626304 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 22:58:12.626394 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.626650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.626748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.626956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.627052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.627339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.627429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.627661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.627759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.627996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.628093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.628318 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.628408 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.628629 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.628718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.628938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.629036 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.629257 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.629348 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.629589 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.629708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.629922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630321 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630867 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.630957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.631178 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.631275 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.631505 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.631607 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.631831 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.631925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.632158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.632255 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.632485 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.632666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.632807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.632935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.633131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.633258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.633469 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.633566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.633830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.633930 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.634224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.634336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.634622 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.634794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.634929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.635215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.635317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.635552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.635687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.635881 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.636167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.636288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.636506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637551 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637662 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637833 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.637903 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.638395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.638499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.638650 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.638735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.638735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.638863 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.639099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.639195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.639615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.639726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.639802 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.639872 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.640987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.641078 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.641269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.641424 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.641603 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.641722 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642414 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642729 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.642938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.643034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.643259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.643361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.643566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.643740 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644177 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644177 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644870 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.644973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.645156 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.645253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.645436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.645526 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.645770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.645893 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.646248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.646357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.646440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.646521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.646769 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.646876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647056 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647612 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.647954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.648052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.648265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.648424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.648588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.648737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.648893 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.649043 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.649373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.649529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.649529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.650596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.650767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.650767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.651161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.651322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.651550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.651764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.651928 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.652099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.652328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.652490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.652657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.652817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.652975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.653139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.653300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.653460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.653685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.653843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.653992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.654297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.654495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.654663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.654814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.654970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.655121 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.655270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.655436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.655596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.655754 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.655904 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.656052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.656389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.656547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.656707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.656867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.657025 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.657182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.657342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.657501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.657712 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.657878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658186 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658347 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658507 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.658972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.659129 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.659297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.659934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.660096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.660264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.660423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.660591 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.660824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.660993 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.661199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.661356 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.661591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.661782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.661950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.662101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.662250 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.662250 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.662642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.662800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.662959 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.663109 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.663295 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.663456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.663614 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.663778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.663937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.664086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.664253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.665125 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.665289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.665536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.666269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.666269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.666734 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.666894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.667045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.667213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.667379 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.667537 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.667942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.668101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.668259 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.668433 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.668836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.668993 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.669150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.669150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.669982 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.670161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.670316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.670465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.670465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.670766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671009 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671174 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671174 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671479 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671628 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.671940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.672090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.672240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.672389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.672634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.672798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.672798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.673107 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.673269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.673419 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.673419 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.673744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.673744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.674054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.674204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.674352 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.674499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.674657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.674807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.675104 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.675272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.675272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.675563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.675733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.675884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.676040 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.676244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.676417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.676723 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.676896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.677048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.677206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.677365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.677535 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.677734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.677890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.678039 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.678189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.678448 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.678448 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.678766 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.678918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.679067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.679224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.679375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.679539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.679805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.680048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.680203 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.680354 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.680503 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.680660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.680819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.681026 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.681251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.681415 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.681566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.681772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.681937 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.682094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.682244 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.682408 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.682563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.682805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.682964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.683123 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.683273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.683429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.683581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.683744 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.683896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.684056 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.684214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.684365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.684516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.684752 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.684912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.685214 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.685372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.685372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.685688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.685688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.685989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.686146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.686307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.686464 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.686629 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.686944 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.687109 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.687260 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.687416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.687566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.687566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.687865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688170 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688778 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.688778 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.689069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.689224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.689386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.689386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.689790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.690014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.690277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.690439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.690610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.690761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.690919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.691083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.691259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.691489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.691675 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.691950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.692107 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.692265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.692429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.692582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.692745 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.692995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.693150 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.693300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.693300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.693596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.693816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.694064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.694242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.694396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.694552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.694711 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.694869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.695031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.695326 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.695490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.695640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.695802 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.695953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.696109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.696264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.696414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.696604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.696795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.697515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.697712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.697881 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698360 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698517 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698667 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.698972 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.699130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.699335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.699538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.699713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.699874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.700055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.700303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.700554 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.700719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.700877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.701042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.701201 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.701360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.701741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.701919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.702084 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.702236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.702401 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.702580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.702732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.702896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.703143 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.703307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.703467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.703624 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.703784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.703941 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.704091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.704248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.704399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.704399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.704718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.704718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.705010 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.705159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.705462 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.705659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.705830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.705983 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.706133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.706282 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.706438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.706600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.706760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.706921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.707079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.707258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.707561 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.707801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.707962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.708113 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.708270 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.708419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.708569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.708733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.708890 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.709063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.709213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.709374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.709524 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.709727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.709893 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.710044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.710200 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.710432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.710701 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.710868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.711026 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.711206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.711365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.711516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.711761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.711919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.712077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.713010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.713274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.713435 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.713601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.713788 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.713954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.714887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.715171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.715336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.715627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.715800 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.715953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.716110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.716271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.716435 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.716594 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.716744 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.716893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.717043 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.717192 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.717361 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.717739 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.717908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.718078 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.718230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.718390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.718590 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.718744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.718931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.719302 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.719469 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.719632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.719792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.719950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.720110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.720269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.720269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.720709 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.720965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.720965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.721286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.721437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.721601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.721896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.722061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.722221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.722381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.722531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.722694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.722846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.723003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.723165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.723407 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.723564 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.723725 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.723883 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724674 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724982 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.724982 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.725277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.725442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.725904 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.726081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.726240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.726391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.726549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.726710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.726912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.727068 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.727219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.727413 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.727570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.727904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.728348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.728615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.728774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.729202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.729371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.729371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.729795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.729948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.730099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.730334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.730518 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.730704 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.731000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.731296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.731483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.731640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.731808 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.732063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.732219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.732378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.732571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.732736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.732936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.733107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.733308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.733605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.733792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.733943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.734154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.734318 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.734480 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.734724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.735263 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.735464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.735584 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.735963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.736133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.736305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.736457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.736955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.737118 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.737325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.737811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.738096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.738382 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.738591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.738745 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.738897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739056 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739220 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739416 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.739739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.741127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.742624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.744436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.745732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.747111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.748931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.750651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.752784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.754082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.754413 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_db.sqlalchemy.engines [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:12.754592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.754592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.754592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.754592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.754592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.755308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.755308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.755745 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.755900 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.756258 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.756501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.756794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.757107 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.757443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.757985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.758157 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.758628 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.758796 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.759027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.759407 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.760057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.760556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.760925 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.761382 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.761576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.761936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.762274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.762566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.762835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.763152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.763466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.763789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.764105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.764431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.764724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.765040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.765352 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.765693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.765995 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.766370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.766636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.766967 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.767287 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.767607 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.767922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.768232 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.768588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.768898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.769240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.769927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.769927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.770279 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.770920 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.770920 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.771246 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.771517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.771831 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.772161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.772632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.772801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.773114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.773435 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.773793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.774120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.774447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.775776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.776347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.776681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.777010 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.777339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.777687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.778021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.778347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.778672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.778992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.779313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.779652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.779986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.780319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.780667 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.780994 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.781318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.781665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.781993 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.782366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.782840 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.783011 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.783301 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.783627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.783954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.784279 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.784602 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.784934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.785256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.785579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.785928 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.786252 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.786962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.786962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.787294 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.787557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.787884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.788208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.788534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.789080 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.789402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.789769 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.790104 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.790578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.792482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.793116 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.793455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.793819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.794153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.794489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.794824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.795147 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.795486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.795818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.796139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.796474 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.796913 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.797400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.797805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.798146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.798485 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.798822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.799232 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.799464 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.799801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.800119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.800439 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.800770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.801092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.801409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.801753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.802082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.802403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.802729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.803293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.803463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.803687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.804004 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.804321 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.804636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.804961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.805277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.805592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.805949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.807299 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.807299 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.807809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.808144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.808471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.808801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.809189 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.809501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.809802 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.810152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.810471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.811908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.811908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.811908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.811908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.812694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.812694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.813163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.813163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.813782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.814057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.814389 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.814755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.815109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.815429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.815748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.816064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.816400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.816726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.817049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.817445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.817705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.818031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.818357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.818678 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.818999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.819340 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.819651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.820009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.820345 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.820674 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.821001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.821332 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.822067 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.822357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.822722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.823147 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.823405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.823848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.824069 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.824388 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.824839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.825167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.825502 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.826307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.826307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.826645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.826805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.827135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.827532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.827787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.828127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.828487 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.828824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.829159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.829499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.829946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.830139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.830418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.830759 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.831101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.831427 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.831759 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.832083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.832413 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.832736 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.833065 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.833395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.834087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.834087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.834398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.834698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.835021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.835342 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.835665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.835982 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.836302 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.836645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.836982 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.838027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.838471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.839082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.839377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.839712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.840037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.840381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.840704 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.841034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.841359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.841718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.842050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.842380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.842720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.843057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.843391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.843730 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.844290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.844474 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.844836 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.845183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.845509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.845870 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.849540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 22:58:12.849540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 22:58:12.872337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_db.sqlalchemy.engines [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:12.910937 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.context [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76bf02e0-29a2-4545-b6a3-dd98a1461c4d(cell1) {{(pid=116339) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 22:58:12.916094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:12.918000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:12.918879 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:12.920911 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:12.933592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_db.sqlalchemy.engines [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:12.934503 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_db.sqlalchemy.engines [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:13.028681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.context [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),76bf02e0-29a2-4545-b6a3-dd98a1461c4d(cell1) {{(pid=116338) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 22:58:13.033155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:13.034795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:13.035626 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:13.037587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:13.048817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_db.sqlalchemy.engines [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:13.050340 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_db.sqlalchemy.engines [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:13.097291 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_db.sqlalchemy.engines [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:13.208444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_db.sqlalchemy.engines [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 22:58:13.424485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: WARNING keystonemiddleware.auth_token [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:58:13.431000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: WARNING keystonemiddleware.auth_token [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:58:13.531267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: WARNING keystonemiddleware.auth_token [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:58:13.537918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: WARNING keystonemiddleware.auth_token [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:58:13.773121 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: WARNING keystonemiddleware.auth_token [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:58:13.779475 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: WARNING keystonemiddleware.auth_token [None req-d54f3002-c4e6-4e9d-b886-d565874b0754 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:58:13.785603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55840a9d39c0 pid: 116339 (default app) Nov 22 22:58:13.881053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: WARNING keystonemiddleware.auth_token [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 22:58:13.887045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: WARNING keystonemiddleware.auth_token [None req-f89aa982-592b-4157-b4c4-5e7f8cd5d45b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 22:58:13.892386 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55840a9d39c0 pid: 116338 (default app) Nov 22 22:58:48.489265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3c4c6b09-93b1-42bc-8bee-e39411134d7f tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Action: 'create', calling method: .version_select at 0x7fefcbe6b4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1700745708"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:58:49.662784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-993696481", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "9bbfe9b4-10d0-433e-bb54-f88a06c5a93e"}]}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:58:50.136838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3c4c6b09-93b1-42bc-8bee-e39411134d7f tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.806234 Nov 22 22:58:50.138013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1154 bytes} [Mon Nov 22 22:58:47 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2809 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 22:58:50.143210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a25ecdc4-b1a0-4ef5-94a0-165422ca1a0f tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefcbd350d0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:50.227036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a25ecdc4-b1a0-4ef5-94a0-165422ca1a0f tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/3dcbe2a8-0432-4ce3-9195-50b6e5cc735e" status: 200 len: 350 microversion: 2.1 time: 0.087575 Nov 22 22:58:50.229355 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 2/2] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:58:50 2021] GET /compute/v2.1/os-volumes/3dcbe2a8-0432-4ce3-9195-50b6e5cc735e => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:50.233979 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-96bd3221-86d7-41c8-98f6-908034261eec tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbd35940>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:50.302929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] validate_networks() for [('9bbfe9b4-10d0-433e-bb54-f88a06c5a93e', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 22:58:51.006664 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-96bd3221-86d7-41c8-98f6-908034261eec tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9" status: 200 len: 346 microversion: 2.1 time: 0.776204 Nov 22 22:58:51.008641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 3/3] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:58:50 2021] GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9 => generated 346 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:51.020181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e4d67873-ed68-4d10-9fa3-80fe5abc0b82 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Action: 'create', calling method: .version_select at 0x7fefcbd35af0>, body: {"snapshot": {"volume_id": "527afd7e-502d-426b-adb8-5c272885c8e9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1086631841"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:58:51.344660 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e4d67873-ed68-4d10-9fa3-80fe5abc0b82 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.328751 Nov 22 22:58:51.346065 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 4/4] 10.222.0.81 () {60 vars in 1161 bytes} [Mon Nov 22 22:58:51 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:51.367708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-507f4a8a-d5aa-41f4-b5d9-cc0e84d8dc3e tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbd47700>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:51.494510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-507f4a8a-d5aa-41f4-b5d9-cc0e84d8dc3e tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.140101 Nov 22 22:58:51.495434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 5/5] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:51 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:51.505797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-014f33c4-eb7b-4b9d-8b3e-acf7fd8b2736 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbd35a60>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:51.660964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-014f33c4-eb7b-4b9d-8b3e-acf7fd8b2736 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.086432 Nov 22 22:58:51.660964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 6/6] 10.222.0.81 () {58 vars in 1139 bytes} [Mon Nov 22 22:58:51 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:51.660964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ab8a6a0a-b4e5-4d4a-9406-da5f719c73fc tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbd47e50>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:51.660964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ab8a6a0a-b4e5-4d4a-9406-da5f719c73fc tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.051852 Nov 22 22:58:51.660964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 7/7] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:51 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:58:52.659330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aaaceb94-bea8-417a-acbc-1507a64ec52c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbd474c0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:52.734778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aaaceb94-bea8-417a-acbc-1507a64ec52c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.078986 Nov 22 22:58:52.735594 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 8/8] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:52 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:52.831076 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 22:58:52.831677 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 22:58:52.832899 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 22:58:52.833418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 22:58:52.833946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 22:58:52.869519 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:52.869519 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:52.870129 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:52.870825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:52.928146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Getting quotas for project 6ae3b6b7cb754497a30d3a41220bef60. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:58:52.944568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Getting quotas for user 82cc3cbc289d42388c931ca501263c06 and project 6ae3b6b7cb754497a30d3a41220bef60. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:58:52.979111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 22:58:52.999154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 22:58:53.193347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-befd1e4e-a38a-49cf-b7ae-5617a31fe661 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.159526 Nov 22 22:58:53.201140 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 1/9] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 22:58:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 4172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 22:58:53.216747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-701c1153-0c2e-4702-a896-06aaac7965e6 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:53.217800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-701c1153-0c2e-4702-a896-06aaac7965e6 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:58:53.502372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-701c1153-0c2e-4702-a896-06aaac7965e6 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:58:53.530590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-701c1153-0c2e-4702-a896-06aaac7965e6 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1214 microversion: 2.1 time: 0.318545 Nov 22 22:58:53.534320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 9/10] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:58:53 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1214 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:58:53.747421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4ff181d4-dfdd-4c09-9a98-6605cf82d46c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbd5a3a0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:53.862815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4ff181d4-dfdd-4c09-9a98-6605cf82d46c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.119529 Nov 22 22:58:53.863461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 2/11] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:53 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:54.552731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4d54c761-45bb-4d3e-9b15-8c1eb910c997 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:54.553388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4d54c761-45bb-4d3e-9b15-8c1eb910c997 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:58:54.877184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0402728e-88c3-4e3f-88cb-3b5e199aadb7 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcb460f70>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:54.936954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0402728e-88c3-4e3f-88cb-3b5e199aadb7 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.065910 Nov 22 22:58:54.937940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 3/12] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:54 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:55.090628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4d54c761-45bb-4d3e-9b15-8c1eb910c997 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:58:55.102356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4d54c761-45bb-4d3e-9b15-8c1eb910c997 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1214 microversion: 2.1 time: 0.552533 Nov 22 22:58:55.103162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 10/13] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:58:54 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1214 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:58:55.948599 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2e4eb831-04a1-4f73-ad83-19ed59ed4940 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcac5c1f0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:56.013504 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2e4eb831-04a1-4f73-ad83-19ed59ed4940 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.069043 Nov 22 22:58:56.014370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 4/14] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:55 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:58:56.120619 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:56.121890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:58:56.140007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:56.144338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:56.145448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:56.146188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:56.712732 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:58:56.739118 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4fcba762-c8b7-4d38-b14c-ba79aa1166f4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1218 microversion: 2.1 time: 0.623514 Nov 22 22:58:56.748399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 11/15] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:58:56 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1218 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:58:57.031138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-357d47ea-e6d2-4e46-b97f-25e31abed56b tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbc8d820>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:57.093566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-357d47ea-e6d2-4e46-b97f-25e31abed56b tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.069998 Nov 22 22:58:57.098057 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 12/16] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:57 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:57.144591 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-aa40c419-7f7c-4240-b2e3-ca4c9cb3a50c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: .version_select at 0x7fefcac5cb80>, body: {"keypair": {"name": "tempest-keypair-1698870683"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:58:57.220777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-aa40c419-7f7c-4240-b2e3-ca4c9cb3a50c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:58:57.233078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-aa40c419-7f7c-4240-b2e3-ca4c9cb3a50c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for user 2b25dcec4c1f4047ae84ce3572ec4da1 and project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:58:57.490164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-aa40c419-7f7c-4240-b2e3-ca4c9cb3a50c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:58:57.496013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-aa40c419-7f7c-4240-b2e3-ca4c9cb3a50c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for user 2b25dcec4c1f4047ae84ce3572ec4da1 and project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:58:57.515572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-aa40c419-7f7c-4240-b2e3-ca4c9cb3a50c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.695898 Nov 22 22:58:57.517097 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 5/17] 10.222.0.81 () {60 vars in 1157 bytes} [Mon Nov 22 22:58:56 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:58:57.765074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:57.765753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:58:57.775476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:57.778783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:57.780822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:57.782590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:57.997245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:58:58.005970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2ab6a748-a4ad-425a-b1bf-727f1c3e8732 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1210 microversion: 2.1 time: 0.245118 Nov 22 22:58:58.012572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 13/18] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:58:57 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1210 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:58:58.107271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a8af13d3-4ced-4df2-9316-dd91d9a3cb1c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcac52af0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:58.173713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a8af13d3-4ced-4df2-9316-dd91d9a3cb1c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 288 microversion: 2.1 time: 0.071867 Nov 22 22:58:58.182278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 6/19] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:58 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:58.192352 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8b68862b-0920-4822-b2e2-1ca90c1a1c17 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbc8dd30>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:58.310625 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8b68862b-0920-4822-b2e2-1ca90c1a1c17 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 202 len: 0 microversion: 2.1 time: 0.121803 Nov 22 22:58:58.314269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 14/20] 10.222.0.81 () {58 vars in 1253 bytes} [Mon Nov 22 22:58:58 2021] DELETE /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 22:58:58.319085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-35a39591-a2a9-4821-b098-45203f35a010 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcabe5ca0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:58.363661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-35a39591-a2a9-4821-b098-45203f35a010 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.048053 Nov 22 22:58:58.370076 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 7/21] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:58 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:58.782150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a7b8d343-f0a3-4bc4-b8e5-2146f67ec960 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefcbc8d8b0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:58.915071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a7b8d343-f0a3-4bc4-b8e5-2146f67ec960 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/843edc57-a202-4ec6-9653-f1ce09cf6b05" status: 200 len: 350 microversion: 2.1 time: 0.100760 Nov 22 22:58:58.915071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 15/22] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:58:58 2021] GET /compute/v2.1/os-volumes/843edc57-a202-4ec6-9653-f1ce09cf6b05 => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:59.030428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:59.031245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:58:59.104242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:59.104929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:59.107235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:58:59.107681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:58:59.379984 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-30f47e35-1b77-44d0-a1c3-a7264277054e tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbc98c10>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:58:59.475444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-30f47e35-1b77-44d0-a1c3-a7264277054e tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.100279 Nov 22 22:58:59.476013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 16/23] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:58:59 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:58:59.594143 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:58:59.644820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7e7708cd-0ec5-41b0-a973-61a380efff69 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1266 microversion: 2.1 time: 0.613314 Nov 22 22:58:59.652000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 8/24] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:58:59 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1266 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:00.491269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5c99dabc-d4a9-4087-b07d-a2cd89226a01 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefca3434c0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:00.551539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5c99dabc-d4a9-4087-b07d-a2cd89226a01 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.066937 Nov 22 22:59:00.552161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 9/25] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:59:00 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:00.627757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8b638a21-ffe2-4a1c-b782-240d330e9ea5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'create', calling method: .version_select at 0x7fefcbc98d30>, body: {"keypair": {"name": "tempest-keypair-935397359"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:00.682577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:00.683238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:00.690882 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:00.691505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:00.692841 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:00.693448 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:00.720290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-8b638a21-ffe2-4a1c-b782-240d330e9ea5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:59:00.734679 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-8b638a21-ffe2-4a1c-b782-240d330e9ea5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for user 66e5af1ce0394d6f963d368036c8c0d5 and project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:59:01.042815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:01.056688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b47a6ba4-553d-4adc-82aa-94eaa179771c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1266 microversion: 2.1 time: 0.400789 Nov 22 22:59:01.058660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 10/26] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:00 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1266 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:01.143863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1582788698", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cb3d985-c2d9-4782-ae33-7bf9b53d9888"}]}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:01.213092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-8b638a21-ffe2-4a1c-b782-240d330e9ea5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:59:01.221969 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-8b638a21-ffe2-4a1c-b782-240d330e9ea5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for user 66e5af1ce0394d6f963d368036c8c0d5 and project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:59:01.234558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] validate_networks() for [('2cb3d985-c2d9-4782-ae33-7bf9b53d9888', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 22:59:01.238990 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8b638a21-ffe2-4a1c-b782-240d330e9ea5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.876689 Nov 22 22:59:01.240198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 17/27] 10.222.0.81 () {62 vars in 1198 bytes} [Mon Nov 22 22:59:00 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 879 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 22:59:01.567629 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-96466b42-b469-43ca-a26e-fa39264c7d99 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcbba84c0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:01.638908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-96466b42-b469-43ca-a26e-fa39264c7d99 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 200 len: 287 microversion: 2.1 time: 0.078395 Nov 22 22:59:01.640712 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 18/28] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:59:01 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:02.074733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:02.075445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:02.089606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:02.090100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:02.090919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:02.091358 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:02.388361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:02.402907 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ff555dab-da4d-4881-bfed-eb491b280fbc tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1284 microversion: 2.1 time: 0.331632 Nov 22 22:59:02.404972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 19/29] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:02 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1284 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:02.522136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 22:59:02.522136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 22:59:02.522136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 22:59:02.522136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 22:59:02.522136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 22:59:02.556882 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:02.557442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:02.558386 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:02.558839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:02.610501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Getting quotas for project 5cfa9a861da442f688818dd77f89bf9f. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:59:02.624228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Getting quotas for user d348368113a04946a77be06091feb5e3 and project 5cfa9a861da442f688818dd77f89bf9f. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:59:02.652918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3f36d0e9-3b20-4619-8cb3-90a9ab04509c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcb3871f0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:02.654420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 22:59:02.661096 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 22:59:02.712702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-3f36d0e9-3b20-4619-8cb3-90a9ab04509c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] HTTP exception thrown: Snapshot 59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 could not be found. Nov 22 22:59:02.713487 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3f36d0e9-3b20-4619-8cb3-90a9ab04509c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Returning 404 to user: Snapshot 59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:02.715213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3f36d0e9-3b20-4619-8cb3-90a9ab04509c tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2" status: 404 len: 111 microversion: 2.1 time: 0.067432 Nov 22 22:59:02.716047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 20/30] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 22:59:02 2021] GET /compute/v2.1/os-snapshots/59752b4b-6f29-4d4c-b5ae-d2b066f3ddd2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 22:59:02.725217 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5ebbb11f-1f47-4b1d-a149-3e0e8ff27f0a tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcc70eca0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:02.783858 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5d1051ef-3188-4d9f-97cc-111a828d4c19 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.721117 Nov 22 22:59:02.788092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 11/31] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 22:59:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 22:59:02.805578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1585b44f-ff95-41ad-bf29-01e9014bff0e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:02.807278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1585b44f-ff95-41ad-bf29-01e9014bff0e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:02.946021 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5ebbb11f-1f47-4b1d-a149-3e0e8ff27f0a tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9" status: 202 len: 0 microversion: 2.1 time: 0.225043 Nov 22 22:59:02.946827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 21/32] 10.222.0.81 () {58 vars in 1247 bytes} [Mon Nov 22 22:59:02 2021] DELETE /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 22:59:02.955139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-10dabb7c-adf2-461c-8bde-f890ef7ac757 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcb3619d0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:03.021761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1585b44f-ff95-41ad-bf29-01e9014bff0e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:03.053880 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1585b44f-ff95-41ad-bf29-01e9014bff0e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1222 microversion: 2.1 time: 0.260900 Nov 22 22:59:03.066422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 12/33] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:02 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:03.131791 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-10dabb7c-adf2-461c-8bde-f890ef7ac757 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9" status: 200 len: 345 microversion: 2.1 time: 0.180277 Nov 22 22:59:03.132969 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 22/34] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:59:02 2021] GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:59:03.191738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1797207425", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2cb3d985-c2d9-4782-ae33-7bf9b53d9888"}]}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:03.318035 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] validate_networks() for [('2cb3d985-c2d9-4782-ae33-7bf9b53d9888', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 22:59:03.335840 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-667493053", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "135c9d2c-b547-438e-b31c-2139e85d4ac9"}], "security_groups": [{"name": "tempest-securitygroup--243857723"}], "key_name": "tempest-keypair-1698870683", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:05.275633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] validate_networks() for [('135c9d2c-b547-438e-b31c-2139e85d4ac9', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 22:59:06.027484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 22:59:06.028707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 22:59:06.030171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 22:59:06.030761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 22:59:06.031446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 22:59:06.066761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:06.067834 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:06.073135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:06.073683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:06.171304 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Getting quotas for project 5cfa9a861da442f688818dd77f89bf9f. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:59:06.194375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Getting quotas for user d348368113a04946a77be06091feb5e3 and project 5cfa9a861da442f688818dd77f89bf9f. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:59:06.247678 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 22:59:06.262962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 22:59:06.497196 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-dc831879-2e1b-4e4f-ae68-08c2a60d089e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.289730 Nov 22 22:59:06.504703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 13/35] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 22:59:03 2021] POST /compute/v2.1/servers => generated 383 bytes in 3318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 22:59:06.531299 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:06.532073 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:06.544333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:06.549227 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:06.550194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:06.550710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:07.678950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:07.686335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-21933c2f-79ff-445f-be8d-5cc3930480cd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 1.180501 Nov 22 22:59:07.686935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 14/36] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:06 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:07.701143 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-279ec7cf-3d3d-4256-b127-75bf8cf449e9 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefca2eb160>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:07.852386 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-279ec7cf-3d3d-4256-b127-75bf8cf449e9 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/b31930a6-4843-487c-b98a-fa946841bb3a" status: 200 len: 350 microversion: 2.1 time: 0.164253 Nov 22 22:59:07.852964 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 15/37] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:59:07 2021] GET /compute/v2.1/os-volumes/b31930a6-4843-487c-b98a-fa946841bb3a => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:07.857414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-216275f0-02c7-433f-a47c-8dc36bc74ddc tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefca2f8670>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:07.960367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-216275f0-02c7-433f-a47c-8dc36bc74ddc tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] HTTP exception thrown: Volume 527afd7e-502d-426b-adb8-5c272885c8e9 could not be found. Nov 22 22:59:07.961569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-216275f0-02c7-433f-a47c-8dc36bc74ddc tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Returning 404 to user: Volume 527afd7e-502d-426b-adb8-5c272885c8e9 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:07.962648 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-216275f0-02c7-433f-a47c-8dc36bc74ddc tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9" status: 404 len: 109 microversion: 2.1 time: 0.108541 Nov 22 22:59:07.963212 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 16/38] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:59:07 2021] GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 22:59:07.972726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:07.973426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:08.003127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:08.003875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:08.004874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:08.013006 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:08.952093 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 22:59:08.952717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 22:59:08.953061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 22:59:08.954101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 22:59:08.954561 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 22:59:08.970378 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:08.973793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:08.976467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:08.977839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:08.980935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-60936676-6f3a-4b45-9899-95a969dbebb6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1218 microversion: 2.1 time: 1.016673 Nov 22 22:59:08.981457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:08.984559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 17/39] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:07 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1218 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:08.996170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-35986a80-9ec5-4af2-9e5c-b01a6d4a964f tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefca2f8f70>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:09.042663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for project 1525897e49c34ebb9215d460e1ad237d. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:59:09.050609 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for user 2b25dcec4c1f4047ae84ce3572ec4da1 and project 1525897e49c34ebb9215d460e1ad237d. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:59:09.068467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 22:59:09.073462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 22:59:09.240701 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-722df0c2-3be6-4cde-b9d1-f76766dfbe06 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.911592 Nov 22 22:59:09.241352 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 23/40] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 22:59:03 2021] POST /compute/v2.1/servers => generated 401 bytes in 5913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 22:59:09.271606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a3982bf8-bcfa-4117-95ea-4232dcc18395 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefcb2f0310>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:09.326149 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-a3982bf8-bcfa-4117-95ea-4232dcc18395 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] HTTP exception thrown: Volume 527afd7e-502d-426b-adb8-5c272885c8e9 could not be found. Nov 22 22:59:09.326834 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a3982bf8-bcfa-4117-95ea-4232dcc18395 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Returning 404 to user: Volume 527afd7e-502d-426b-adb8-5c272885c8e9 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:09.329217 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a3982bf8-bcfa-4117-95ea-4232dcc18395 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9" status: 404 len: 109 microversion: 2.1 time: 0.074947 Nov 22 22:59:09.330074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 24/41] 10.222.0.81 () {58 vars in 1247 bytes} [Mon Nov 22 22:59:09 2021] DELETE /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 22:59:09.337483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2059029604", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf77bdb8-32c3-46df-9787-173ffafa8e98"}], "security_groups": [{"name": "tempest-securitygroup--275024318"}], "key_name": "tempest-keypair-935397359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:09.352238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-35986a80-9ec5-4af2-9e5c-b01a6d4a964f tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.363996 Nov 22 22:59:09.364495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 18/42] 10.222.0.81 () {58 vars in 1133 bytes} [Mon Nov 22 22:59:08 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:09.364495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:09.364495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:09.381731 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:09.383093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:09.384219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:09.386187 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:09.909481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] validate_networks() for [('bf77bdb8-32c3-46df-9787-173ffafa8e98', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 22:59:11.445906 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:11.456262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-70bbfe84-bcb7-4e2b-8b4d-45645ca4e876 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 2.097297 Nov 22 22:59:11.456865 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 19/43] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:09 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:11.463708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:11.466269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:11.478720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:11.481597 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:11.483262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:11.484062 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:11.781238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:11.807733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3fb02799-9335-463a-acdf-93b199f3374e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1241 microversion: 2.1 time: 0.348306 Nov 22 22:59:11.809001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 20/44] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:11 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1241 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:11.813944 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f36df0f4-3328-41b0-88bc-a87fac8c2b68 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Calling method '.version_select at 0x7fefca3068b0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:11.857701 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-f36df0f4-3328-41b0-88bc-a87fac8c2b68 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] HTTP exception thrown: Volume 527afd7e-502d-426b-adb8-5c272885c8e9 could not be found. Nov 22 22:59:11.859126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f36df0f4-3328-41b0-88bc-a87fac8c2b68 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] Returning 404 to user: Volume 527afd7e-502d-426b-adb8-5c272885c8e9 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:11.860339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f36df0f4-3328-41b0-88bc-a87fac8c2b68 tempest-VolumesSnapshotsTestJSON-221771733 tempest-VolumesSnapshotsTestJSON-221771733-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9" status: 404 len: 109 microversion: 2.1 time: 0.050076 Nov 22 22:59:11.861404 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 21/45] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:59:11 2021] GET /compute/v2.1/os-volumes/527afd7e-502d-426b-adb8-5c272885c8e9 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 22:59:11.870397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-489e47c0-f0f7-4ed5-af60-e8d522c75e02 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefca2f84c0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:12.237901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-489e47c0-f0f7-4ed5-af60-e8d522c75e02 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.371766 Nov 22 22:59:12.238822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 22/46] 10.222.0.81 () {58 vars in 1148 bytes} [Mon Nov 22 22:59:11 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:12.239189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 22:59:12.243966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 22:59:12.244639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 22:59:12.247375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 22:59:12.248363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 22:59:12.263484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:12.267683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:12.296150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:12.297424 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:12.321229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:12.322527 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:12.324365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:12.329753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:12.332725 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:12.340347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:12.423641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 22:59:12.440515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for user 66e5af1ce0394d6f963d368036c8c0d5 and project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 22:59:12.512909 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 22:59:12.512909 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 22:59:12.651482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ad0f6f0e-73a2-436a-a230-668c9e976793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.316698 Nov 22 22:59:12.659833 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 25/47] 10.222.0.81 () {62 vars in 1187 bytes} [Mon Nov 22 22:59:09 2021] POST /compute/v2.1/servers => generated 401 bytes in 3329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 22:59:12.686244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:12.710970 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f4b360a6-fac5-466d-ac48-07e49fbe5ebe tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1292 microversion: 2.1 time: 0.461843 Nov 22 22:59:12.712538 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 23/48] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:12 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1292 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:12.725353 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c885d1a6-ee4d-4f76-a44d-c6cc36ccec4c tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefca343430>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:13.016158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c885d1a6-ee4d-4f76-a44d-c6cc36ccec4c tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.300018 Nov 22 22:59:13.017202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 24/49] 10.222.0.81 () {58 vars in 1133 bytes} [Mon Nov 22 22:59:12 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:13.025209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:13.028181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:13.047330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.048949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:13.052391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.052990 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:13.421402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-a72e41de-d418-4c75-9b05-125d99e07cbf req-46399cf1-c00f-44bd-8657-a8cb15d7ece9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb", "tag": "2003a573-a8f5-4bc2-a99c-24a637138c9a"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:13.424342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:13.424342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 22:59:13.454362 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a72e41de-d418-4c75-9b05-125d99e07cbf req-46399cf1-c00f-44bd-8657-a8cb15d7ece9 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.456862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a72e41de-d418-4c75-9b05-125d99e07cbf req-46399cf1-c00f-44bd-8657-a8cb15d7ece9 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:13.516817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-a72e41de-d418-4c75-9b05-125d99e07cbf req-46399cf1-c00f-44bd-8657-a8cb15d7ece9 service nova] Creating event network-changed:2003a573-a8f5-4bc2-a99c-24a637138c9a for instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb on hv-cinder-81883 Nov 22 22:59:13.520631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a72e41de-d418-4c75-9b05-125d99e07cbf req-46399cf1-c00f-44bd-8657-a8cb15d7ece9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 22:59:13.527619 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.528298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:13.529297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.530064 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:13.549699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.compute.rpcapi [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 22:59:13.556198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] Releasing lock "compute-rpcapi-router" {{(pid=116339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 22:59:13.630132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b95caa09-1c7e-492d-8201-ad4662fb567c None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.969050 Nov 22 22:59:13.631106 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 26/50] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:13.636841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-13c87f9a-5e3b-40af-a109-9aee0f488b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:13.638690 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-13c87f9a-5e3b-40af-a109-9aee0f488b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:13.914019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-13c87f9a-5e3b-40af-a109-9aee0f488b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:13.936404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-13c87f9a-5e3b-40af-a109-9aee0f488b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:13.946229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-13c87f9a-5e3b-40af-a109-9aee0f488b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:13.956026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-13c87f9a-5e3b-40af-a109-9aee0f488b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1281 microversion: 2.20 time: 0.315807 Nov 22 22:59:13.956705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 27/51] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:13 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:13.975483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:13.976432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:13.997716 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.998172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:13.998968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:13.999398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:14.443384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:14.464705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8cd2afbd-3a6e-4a93-b390-188290f4cfd5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1289 microversion: 2.1 time: 0.493283 Nov 22 22:59:14.468043 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 28/52] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:13 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1289 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:14.478582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-001c3632-6f83-4279-b790-a551f3248733 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefc9a62ee0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:14.549524 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:14.562627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-310e0f42-ab08-4ad0-a70d-45efb6da82f9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 1.543010 Nov 22 22:59:14.564360 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 25/53] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:13 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:14.582288 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:14.583624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:14.607879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:14.614328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:14.620553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:14.625902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:14.840809 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-001c3632-6f83-4279-b790-a551f3248733 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.370660 Nov 22 22:59:14.841793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 29/54] 10.222.0.81 () {58 vars in 1166 bytes} [Mon Nov 22 22:59:14 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:14.855591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-df2555b3-9cb8-47fb-acc9-602d24075f65 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefcb2f08b0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:14.911245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:14.923557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-eec88710-938a-4814-b7af-f9defec39491 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1280 microversion: 2.1 time: 0.357269 Nov 22 22:59:14.924153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 26/55] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:14 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1280 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:14.978166 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:14.980303 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:14.983966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-df2555b3-9cb8-47fb-acc9-602d24075f65 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.132900 Nov 22 22:59:14.984612 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 30/56] 10.222.0.81 () {58 vars in 1169 bytes} [Mon Nov 22 22:59:14 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:14.995762 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:14.998069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3d141523-88ef-45fb-972f-6d5221a9fbbb tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefc9a718b0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:14.999593 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.002114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.003783 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.184402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:15.191173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3d141523-88ef-45fb-972f-6d5221a9fbbb tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.196511 Nov 22 22:59:15.194208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:15.198827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 31/57] 10.222.0.81 () {58 vars in 1154 bytes} [Mon Nov 22 22:59:14 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:15.201088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:15.202546 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e9c74aad-6190-41d9-b7e6-12be7907c7ef tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1277 microversion: 2.20 time: 0.229610 Nov 22 22:59:15.204083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b54425eb-827f-4520-b889-2f21a16135e8 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefc9a71550>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:15.205053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 27/58] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:14 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:15.370643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b54425eb-827f-4520-b889-2f21a16135e8 tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.170679 Nov 22 22:59:15.371441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 32/59] 10.222.0.81 () {58 vars in 1187 bytes} [Mon Nov 22 22:59:15 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:15.388284 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ce8a4d41-a557-4fcd-a240-763f78c07a6b tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] Calling method '.version_select at 0x7fefca2f8f70>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:15.489447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:15.490133 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:15.509003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.510238 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.511653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.512726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.595241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ce8a4d41-a557-4fcd-a240-763f78c07a6b tempest-VolumesTestJSON-1671939193 tempest-VolumesTestJSON-1671939193-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.214312 Nov 22 22:59:15.603891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 28/60] 10.222.0.81 () {58 vars in 1154 bytes} [Mon Nov 22 22:59:15 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:15.603891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:15.603891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:15.609271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.609768 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.610558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.610996 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.744974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:15.770100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32f1def1-2edc-41c5-897f-ab24e68f4c59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1297 microversion: 2.1 time: 0.282184 Nov 22 22:59:15.782518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 33/61] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:15 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1297 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:15.943850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:15.945117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:15.965585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.970365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:15.971578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:15.973177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:16.670060 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:16.680919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-591aac3e-4146-4a37-ae08-25efe6779d05 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 1.083715 Nov 22 22:59:16.685639 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 29/62] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:15 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:16.693781 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:16.694415 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:16.709202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:16.722088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:16.722088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:16.722088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:16.728103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:16.742008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-18b70e5c-cc4c-48b7-b0a3-4093cc404cd9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.800873 Nov 22 22:59:16.744105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 34/63] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:15 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:16.789836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:16.790817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:16.798377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:16.798981 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:16.799902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:16.800454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:16.868944 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:16.899970 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:16.904601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:16.906971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:16.908283 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-eef87d35-3e9a-4b1f-9558-19bc3a72b521 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1333 microversion: 2.20 time: 0.218558 Nov 22 22:59:16.911250 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 30/64] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:16 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1333 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:16.918195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-631e1405-3856-42df-b8dc-30eff34bafb8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1295 microversion: 2.1 time: 0.130325 Nov 22 22:59:16.920791 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 35/65] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:16 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:17.021131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-694524d9-8659-4af7-8338-7e957ebf904b req-a4522b03-57a1-499f-85e4-dbb9aab67640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cf0f00-ab35-48da-bd27-6fba3194dcff", "tag": "4d61dd9a-fb6c-4061-9f0b-4ccda1fd6948"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:17.026931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:17.026931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 22:59:17.054820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-694524d9-8659-4af7-8338-7e957ebf904b req-a4522b03-57a1-499f-85e4-dbb9aab67640 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.055264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-694524d9-8659-4af7-8338-7e957ebf904b req-a4522b03-57a1-499f-85e4-dbb9aab67640 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.079178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-694524d9-8659-4af7-8338-7e957ebf904b req-a4522b03-57a1-499f-85e4-dbb9aab67640 service nova] Creating event network-changed:4d61dd9a-fb6c-4061-9f0b-4ccda1fd6948 for instance 51cf0f00-ab35-48da-bd27-6fba3194dcff on hv-cinder-81883 Nov 22 22:59:17.079789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-694524d9-8659-4af7-8338-7e957ebf904b req-a4522b03-57a1-499f-85e4-dbb9aab67640 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 22:59:17.082088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.082548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.083364 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.083841 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.094017 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.compute.rpcapi [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 22:59:17.094929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] Releasing lock "compute-rpcapi-router" {{(pid=116338) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 22:59:17.130038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-73043185-5158-4570-a6fb-e26f3d7df671 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115911 Nov 22 22:59:17.130678 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 31/66] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:17.613917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-f9ad85cc-a5c7-414b-a75c-ccef2e0b4627 req-3a632faa-eb09-4367-9fed-36143a17e1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13394410-ae52-4acb-8d11-e061a4ae89a3", "tag": "00b76964-7845-4ede-805d-663e9d646d8b"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:17.615467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:17.615467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 22:59:17.623012 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f9ad85cc-a5c7-414b-a75c-ccef2e0b4627 req-3a632faa-eb09-4367-9fed-36143a17e1c9 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.623462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f9ad85cc-a5c7-414b-a75c-ccef2e0b4627 req-3a632faa-eb09-4367-9fed-36143a17e1c9 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.633836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-f9ad85cc-a5c7-414b-a75c-ccef2e0b4627 req-3a632faa-eb09-4367-9fed-36143a17e1c9 service nova] Creating event network-changed:00b76964-7845-4ede-805d-663e9d646d8b for instance 13394410-ae52-4acb-8d11-e061a4ae89a3 on hv-cinder-81883 Nov 22 22:59:17.638709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-f9ad85cc-a5c7-414b-a75c-ccef2e0b4627 req-3a632faa-eb09-4367-9fed-36143a17e1c9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082504 Nov 22 22:59:17.639281 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 36/67] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:59:17.701005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:17.701758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:17.708911 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.709375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.710543 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.711102 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.761372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:17.762141 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:17.777149 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.777644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.778453 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.779196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.957482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:17.968306 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f0a2ccf7-b2f5-4bfd-aee7-5119d5f61dfa tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.272358 Nov 22 22:59:17.969260 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 32/68] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:17 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:17.981709 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:17.982465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:17.989032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.989608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.990629 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:17.991140 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:17.996567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:18.004265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-121d3ca8-373e-4542-8a79-2be5b06f2359 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.247794 Nov 22 22:59:18.004835 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 37/69] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:17 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:18.015101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:18.015850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:18.022265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:18.023403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:18.024897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:18.025169 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:18.095252 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:18.106959 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:18.108935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:18.111333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f2af887e-23ee-4c37-a4fa-a7fd9ddbe3ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1333 microversion: 2.20 time: 0.139630 Nov 22 22:59:18.112025 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 33/70] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:17 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:18.179053 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:18.188073 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ad2160a5-95fe-4332-b281-ea9235b67d8b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1295 microversion: 2.1 time: 0.182092 Nov 22 22:59:18.189027 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 38/71] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:18 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:18.989235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:18.991875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:19.008345 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:19.011483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:19.012085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:19.012571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:19.022748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:19.024693 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:19.043857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:19.044728 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:19.045999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:19.050544 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:19.944097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:19.954774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ffcfff80-8c61-4a62-ad58-596e1b573b8f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.937447 Nov 22 22:59:19.965204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 39/72] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:19 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:19.971987 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:19.972895 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:19.973925 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:19.981197 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:19.982314 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:19.982470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a35eca98-162d-4eb7-8e1e-df2c64c8b73f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.996831 Nov 22 22:59:19.983451 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:19.984075 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:19.994570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 34/73] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:18 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:19.999565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:20.000177 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:20.014402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:20.014884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:20.015674 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:20.016111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:20.131699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:20.154071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:20.155914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:20.157560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8c614bf8-0616-4b35-90df-18d3e57f4b17 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1339 microversion: 2.20 time: 0.190958 Nov 22 22:59:20.159514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 40/74] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:19 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:20.667045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-21be5a15-1fd0-495e-bcf5-f8d9437e84db req-c34f18fa-cf56-4156-9fda-6f8087b80b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce09954f-3efe-4542-9eb8-c1be3bc21549", "tag": "fa888e86-c386-4687-8daf-0f95de7ce011"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:20.669003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:20.669003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 22:59:20.681602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-21be5a15-1fd0-495e-bcf5-f8d9437e84db req-c34f18fa-cf56-4156-9fda-6f8087b80b31 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:20.682794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-21be5a15-1fd0-495e-bcf5-f8d9437e84db req-c34f18fa-cf56-4156-9fda-6f8087b80b31 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:20.696927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:20.708578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-21be5a15-1fd0-495e-bcf5-f8d9437e84db req-c34f18fa-cf56-4156-9fda-6f8087b80b31 service nova] Creating event network-changed:fa888e86-c386-4687-8daf-0f95de7ce011 for instance ce09954f-3efe-4542-9eb8-c1be3bc21549 on hv-cinder-81883 Nov 22 22:59:20.711664 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-faf52e59-83f8-4d90-b1a5-60f525722381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.715490 Nov 22 22:59:20.715185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 35/75] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:19 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:20.727367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-21be5a15-1fd0-495e-bcf5-f8d9437e84db req-c34f18fa-cf56-4156-9fda-6f8087b80b31 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067527 Nov 22 22:59:20.728364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 41/76] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:20.973208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:20.974037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:20.983442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:20.984145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:20.985106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:20.985750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.012385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:21.013568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:21.025641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:21.028271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.030708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:21.031358 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.376857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:21.390708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1d545830-ec46-49d4-90ec-f196f9b09037 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.422367 Nov 22 22:59:21.405026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:21.407316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 36/77] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:20 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:21.412379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:21.413072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:21.415494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-527ecb93-7b8f-4d2c-bc5f-8f82b1489ad0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.408135 Nov 22 22:59:21.419563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:21.420845 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.422974 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:21.424105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.425682 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 42/78] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:21 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:21.732481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:21.733187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:21.740125 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:21.740702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.742399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:21.743172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:21.752934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:21.770307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:21.772656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:21.773885 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-409d39ab-67cf-45ac-b7b5-9acf8385c714 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.365444 Nov 22 22:59:21.784311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 37/79] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:21 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:21.914372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:21.934497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0bb6b1f4-6cb0-49de-a4f7-e38fd1f83ea4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.205757 Nov 22 22:59:21.935103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 43/80] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:21 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:22.411241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.415047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:22.419626 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.420287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.421322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.421759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.439068 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6d29ced9-2a51-4d4c-bff0-9c1ecdf218a7 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Action: 'create', calling method: .version_select at 0x7fefca2eb280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-790606725", "metadata": {"Type": "work"}}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:22.440547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6d29ced9-2a51-4d4c-bff0-9c1ecdf218a7 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:22.441343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6d29ced9-2a51-4d4c-bff0-9c1ecdf218a7 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133164 Nov 22 22:59:22.441918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 38/81] 10.222.0.81 () {60 vars in 1155 bytes} [Mon Nov 22 22:59:22 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 22 22:59:22.447888 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.448497 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:22.456684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.457125 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.458045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.458478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.633042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:22.641101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d25a8468-112b-421a-8127-20d706c51c35 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.235271 Nov 22 22:59:22.641716 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 44/82] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:22 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:22.645838 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:22.646541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a098996f-305a-47ff-84a6-d511db439245 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Action: 'create', calling method: .version_select at 0x7fefc9a8e310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-142933429", "metadata": {"Type": "work"}}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:22.648824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a098996f-305a-47ff-84a6-d511db439245 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:22.649569 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a098996f-305a-47ff-84a6-d511db439245 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006945 Nov 22 22:59:22.650149 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 45/83] 10.222.0.81 () {60 vars in 1155 bytes} [Mon Nov 22 22:59:22 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 22:59:22.656839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8f4b2952-faec-4291-b5aa-0378d70ec4fd tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.213710 Nov 22 22:59:22.657956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 39/84] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:22 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:22.659603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fd4ffdbd-2ad8-4610-a250-b315e24f2ef6 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Action: 'create', calling method: .version_select at 0x7fefc9a62e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-982007800", "metadata": {"Type": "work"}}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:22.660665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fd4ffdbd-2ad8-4610-a250-b315e24f2ef6 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:22.661454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fd4ffdbd-2ad8-4610-a250-b315e24f2ef6 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005796 Nov 22 22:59:22.662160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 46/85] 10.222.0.81 () {60 vars in 1155 bytes} [Mon Nov 22 22:59:22 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 22:59:22.671180 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-886ff58f-6865-432a-ab6d-48502902b930 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Calling method '.version_select at 0x7fefca306f70>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.712224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-886ff58f-6865-432a-ab6d-48502902b930 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] HTTP exception thrown: Volume tempest-invalid-26952009 could not be found. Nov 22 22:59:22.712819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-886ff58f-6865-432a-ab6d-48502902b930 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Returning 404 to user: Volume tempest-invalid-26952009 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:22.713750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-886ff58f-6865-432a-ab6d-48502902b930 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-26952009" status: 404 len: 97 microversion: 2.1 time: 0.046126 Nov 22 22:59:22.714223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 40/86] 10.222.0.81 () {58 vars in 1211 bytes} [Mon Nov 22 22:59:22 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-26952009 => generated 97 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 22 22:59:22.724077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ff848f54-6436-4691-8002-1cfdc410dd9f tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004577 Nov 22 22:59:22.724587 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 47/87] 10.222.0.81 () {58 vars in 1139 bytes} [Mon Nov 22 22:59:22 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 22:59:22.733240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-19bd61f1-5108-4879-9926-5d929a51e08f tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003507 Nov 22 22:59:22.733762 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 41/88] 10.222.0.81 () {58 vars in 1136 bytes} [Mon Nov 22 22:59:22 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 22:59:22.742856 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-795997c5-76e0-445c-b1be-c8d28739ff3c tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Calling method '.version_select at 0x7fefc9a625e0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.770535 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-795997c5-76e0-445c-b1be-c8d28739ff3c tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] HTTP exception thrown: Volume ae805eda-b107-4ce6-95cf-e5eaec8e5b83 could not be found. Nov 22 22:59:22.771134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-795997c5-76e0-445c-b1be-c8d28739ff3c tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Returning 404 to user: Volume ae805eda-b107-4ce6-95cf-e5eaec8e5b83 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:22.771966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-795997c5-76e0-445c-b1be-c8d28739ff3c tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/ae805eda-b107-4ce6-95cf-e5eaec8e5b83" status: 404 len: 109 microversion: 2.1 time: 0.033239 Nov 22 22:59:22.772538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 48/89] 10.222.0.81 () {58 vars in 1247 bytes} [Mon Nov 22 22:59:22 2021] DELETE /compute/v2.1/os-volumes/ae805eda-b107-4ce6-95cf-e5eaec8e5b83 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 22:59:22.782224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76faff04-89be-4a13-a290-e7b232089612 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Calling method '.version_select at 0x7fefca2bce50>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.792234 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.792846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:22.799761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.800238 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.801048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.801485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.811461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-76faff04-89be-4a13-a290-e7b232089612 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] HTTP exception thrown: Volume d76635fa-c160-4c48-9ada-9f6e586c6770 could not be found. Nov 22 22:59:22.812059 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76faff04-89be-4a13-a290-e7b232089612 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] Returning 404 to user: Volume d76635fa-c160-4c48-9ada-9f6e586c6770 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 22:59:22.812943 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-76faff04-89be-4a13-a290-e7b232089612 tempest-VolumesNegativeTest-1976834202 tempest-VolumesNegativeTest-1976834202-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/d76635fa-c160-4c48-9ada-9f6e586c6770" status: 404 len: 109 microversion: 2.1 time: 0.034339 Nov 22 22:59:22.813428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 42/90] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 22:59:22 2021] GET /compute/v2.1/os-volumes/d76635fa-c160-4c48-9ada-9f6e586c6770 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 22:59:22.958983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:22.960703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:22.968899 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.969371 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.969683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:22.970277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:22.970714 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:22.979649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:22.981227 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:22.982390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6d9a400d-ef92-4f32-a323-031937cc45f9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.194429 Nov 22 22:59:22.982962 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 49/91] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:22 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:23.116879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:23.125653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-07e854a9-0867-45da-a5e6-e4e32ccb7aa2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.169860 Nov 22 22:59:23.125653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 43/92] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:22 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:23.658842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:23.659447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:23.666161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:23.666855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:23.667627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:23.668048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:23.675242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:23.676770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:23.685734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:23.687241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:23.688352 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:23.689729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:24.151244 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:24.155322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:24.167052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5b9c7565-f589-4414-9684-5518c0ac2c8c tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.495018 Nov 22 22:59:24.167761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 44/93] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:23 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:24.174685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:24.178523 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:24.189341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bb3f6111-07ff-4937-a3e2-670e55e21af1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.533817 Nov 22 22:59:24.191557 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 50/94] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:23 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:24.192674 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:24.193133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:24.193985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:24.194985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:24.200812 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:24.202403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:24.212267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:24.213385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:24.214758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:24.215731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:24.587946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:24.605914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:24.609262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:24.613158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:24.616188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bd7c5d46-d990-4357-a11d-780a33bf3a1b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.447096 Nov 22 22:59:24.616770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 45/95] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:24 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:24.634476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-711b99ae-576a-43b2-8795-2ac09d82fc63 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.441302 Nov 22 22:59:24.635428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 51/96] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:24 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:24.989313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-002e6b4e-85eb-4ddd-82b5-e47bcbc6fc2f req-67e55d7a-386a-4ed5-9a4e-5529e8a2253c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:24.992457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:24.992457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 22:59:25.004975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-002e6b4e-85eb-4ddd-82b5-e47bcbc6fc2f req-67e55d7a-386a-4ed5-9a4e-5529e8a2253c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.005450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-002e6b4e-85eb-4ddd-82b5-e47bcbc6fc2f req-67e55d7a-386a-4ed5-9a4e-5529e8a2253c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.029063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-002e6b4e-85eb-4ddd-82b5-e47bcbc6fc2f req-67e55d7a-386a-4ed5-9a4e-5529e8a2253c service nova] Creating event network-changed:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 22:59:25.035322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-002e6b4e-85eb-4ddd-82b5-e47bcbc6fc2f req-67e55d7a-386a-4ed5-9a4e-5529e8a2253c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049407 Nov 22 22:59:25.036236 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 46/97] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:25.197144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:25.198312 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:25.210669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.213416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.214597 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.215247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:25.216629 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:25.216957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.233947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.234393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.235432 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.236344 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.530867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:25.535096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:25.540502 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-632e4a50-ab91-468a-bfc3-61febcdc1fef tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.335790 Nov 22 22:59:25.541064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 47/98] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:25 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:25.544289 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-81056fba-c8da-4568-802e-022a1c02a6d7 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.351653 Nov 22 22:59:25.544840 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 52/99] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:25 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:25.638610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:25.639413 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:25.646154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.646817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.654457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:25.655219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:25.661940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.663635 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.671182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.671868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:25.672982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:25.673559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:26.005391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:26.013453 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:26.016940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:26.016940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:26.017300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a8e6e003-eea9-4fec-98b0-8dc23331f344 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.382391 Nov 22 22:59:26.017707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 48/100] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:25 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:26.027767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4e1de866-771a-4064-884d-0bf85a4e1a69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.376937 Nov 22 22:59:26.028418 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 53/101] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:25 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:26.559689 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:26.560297 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:26.560894 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:26.561574 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:26.566494 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:26.567178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:26.567627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:26.568080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:26.568632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:26.568860 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:26.569321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:26.569741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:26.812445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:26.815436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:26.823573 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2878fc2d-158c-48db-8bfe-7f99b34a133f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.266205 Nov 22 22:59:26.824290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 54/102] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:26 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:26.824939 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-341b253d-4590-46a7-ae46-034a6263ea76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.269524 Nov 22 22:59:26.826186 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 49/103] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:26 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:27.035770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:27.036372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:27.043694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.044338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.045369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.045588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:27.046063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.046234 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:27.052619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.053068 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.053902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.054675 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.313487 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:27.322860 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:27.323129 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:27.324572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:27.325977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7c27c55e-19ce-40a8-b1a6-9b79cb8263f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.293787 Nov 22 22:59:27.326603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 55/104] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:27 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:27.343488 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9a03768e-a55e-4441-bb04-5db3c3e1a682 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.301851 Nov 22 22:59:27.344051 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 50/105] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:27 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:27.841879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:27.842670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:27.849985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.850551 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.852443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.853122 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.853392 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:27.854091 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:27.871421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.872017 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:27.873174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:27.873831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:28.118473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:28.125744 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0b18468c-1faa-4cf2-bd67-2ff95c45a485 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.287589 Nov 22 22:59:28.126346 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 51/106] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:27 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:28.150541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:28.158120 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c47fcacf-3c08-45f6-836e-722968bb42ce tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.320736 Nov 22 22:59:28.158744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 56/107] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:27 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:28.345337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:28.346044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:28.353447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:28.353940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:28.354731 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:28.355470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:28.360109 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:28.360721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:28.367301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:28.367803 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:28.368586 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:28.369023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:28.562257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:28.572763 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:28.574324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:28.575071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:28.575469 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e74c2e2f-c0c5-45d5-81f3-bb7d5ffbdc6d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.234003 Nov 22 22:59:28.576200 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 52/108] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:28 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:28.588226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5d7ba5a9-ebcc-44ba-a3ae-4697da56ae5b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.231712 Nov 22 22:59:28.588936 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 57/109] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:28 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:29.142907 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:29.143517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:29.149787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.150244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.151021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.151456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.175536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:29.176200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:29.182648 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.183083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.183999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.184491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.347192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:29.366565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2e4606fd-ae65-4eee-b941-0036fef225d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.226531 Nov 22 22:59:29.367331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 53/110] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:29 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:29.378388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:29.386637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d348a264-ff5f-4562-b81e-7c869b3d7983 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.214852 Nov 22 22:59:29.387211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 58/111] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:29 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:29.593921 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:29.594525 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:29.600385 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.601022 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.602058 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.602520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.605364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:29.606013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:29.613121 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.613577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.614382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:29.614819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:29.796438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:29.805038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:29.806586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:29.807708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e214cd28-c9a0-4932-8a06-4269fbad228e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.217429 Nov 22 22:59:29.808641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 54/112] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:29 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:29.812459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:29.820609 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bf98b7d8-6c61-4801-ada5-871c6998a8f3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.218721 Nov 22 22:59:29.821568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 59/113] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:29 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:30.382892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:30.383598 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:30.389309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.389790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.390571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.390999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.406318 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:30.408399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:30.418713 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.419347 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.420419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.421037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.698866 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:30.705265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:30.706414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8cddad19-7c99-4d2b-bdb7-f87233fd3b47 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.327214 Nov 22 22:59:30.707085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 55/114] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:30 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:30.712902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-78a115fd-4e9c-4119-ab2d-97f5d112e8e2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.313078 Nov 22 22:59:30.713492 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 60/115] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:30 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:30.825775 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:30.826375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:30.833934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.834386 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.835208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.835656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.837528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:30.838437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:30.849927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.850754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:30.852346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:30.852796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:31.137992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:31.150596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:31.151265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ec1d004f-8f11-4637-a404-b2f89841314a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.316947 Nov 22 22:59:31.151933 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 61/116] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:30 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:31.169864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:31.171665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:31.173072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-445acb06-4e0b-45ae-a1e1-f4adf875f90e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.350999 Nov 22 22:59:31.173786 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 56/117] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:30 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:31.723289 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:31.723995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:31.730693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:31.731189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:31.731287 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:31.731874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:31.732755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:31.733368 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:31.737641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:31.738255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:31.738959 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:31.739420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:31.930964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:31.938631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5463223d-48f5-452c-a924-6897ef96c999 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.218925 Nov 22 22:59:31.939591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 62/118] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:31 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:31.943015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:31.950812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-afdc5dcb-0dce-49bf-8468-c577c4826531 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.224200 Nov 22 22:59:31.951587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 57/119] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:31 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:32.168429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:32.169205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:32.183676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.183676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.183676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.183676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.191989 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:32.192302 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:32.205135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.205586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.206406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.206849 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.407647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:32.416598 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-857e73f0-59d4-446f-a254-bc40ecdf3ca5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.251713 Nov 22 22:59:32.417181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 63/120] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:32 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:32.433003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:32.440978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:32.442537 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:32.443631 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c2ef84aa-cb92-46a8-b5cb-dcbf4a9c21a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.255565 Nov 22 22:59:32.444285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 58/121] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:32 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:32.955630 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:32.956237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:32.963389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.963994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.964769 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.965205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.973235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:32.974070 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:32.980960 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.981409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:32.982230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:32.982666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:33.159995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:33.169411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cf611627-f811-4b85-ba32-efe3612aea50 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.217258 Nov 22 22:59:33.170018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 64/122] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:32 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:33.183692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:33.191154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8fbb22bb-8f29-4993-97ed-ecb9399696d5 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.221666 Nov 22 22:59:33.192027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 59/123] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:32 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:33.433195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:33.433874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:33.439709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:33.440156 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:33.440925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:33.441360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:33.467470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:33.468082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:33.480447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:33.480891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:33.481700 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:33.482248 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:33.687123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:33.690780 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:33.695269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-210a201d-6ea2-47cc-bba0-be6758830e61 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.265675 Nov 22 22:59:33.695970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 65/124] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:33 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:33.700066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:33.701663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:33.702833 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-95b02aea-13b6-45fe-9494-7bce96553edc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.241257 Nov 22 22:59:33.703457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 60/125] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:33 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:34.186008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:34.186611 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:34.192517 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.192965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.193878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.194927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.210514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:34.213136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:34.221418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.222040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.222825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.223252 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.396522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:34.406599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cc408f09-7f7c-4391-b3f0-f8884b7bcb59 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.224127 Nov 22 22:59:34.407252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 66/126] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:34 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:34.421985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:34.430468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6098046c-23ed-4fa5-80a9-dcdda676bbbb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.225635 Nov 22 22:59:34.431393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 61/127] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:34 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:34.713011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:34.713642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:34.719946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.720325 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:34.720461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.720930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:34.721173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.721626 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.727916 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.728367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.729235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:34.729732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:34.920867 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:34.929945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a4691403-ff89-4849-ac42-c5e505df0944 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.220413 Nov 22 22:59:34.930528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 67/128] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:34 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:34.930964 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:34.940086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:34.941546 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:34.942712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-caa0be01-cd3d-40b2-8664-7d95087aff20 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.226352 Nov 22 22:59:34.943300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 62/129] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:34 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:35.423943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:35.424582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:35.431147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.431620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.432464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.432903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.450558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:35.451406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:35.462674 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.464066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.464924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.465544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.641707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:35.650239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ef826780-a843-4efa-8f87-984135b1e50c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.229710 Nov 22 22:59:35.650829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 68/130] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:35 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:35.672165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:35.679536 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2309b724-c6a4-45a1-afbd-ad5614b0a6a4 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.236283 Nov 22 22:59:35.680086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 63/131] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:35 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:35.948002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:35.948615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:35.955457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.955746 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.956700 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.957277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.961816 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:35.962857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:35.969865 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.970315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:35.971094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:35.971526 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:36.151926 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:36.160540 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a2c13c87-ca39-486d-83b7-73b34856df9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.215992 Nov 22 22:59:36.161274 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 69/132] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:35 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:36.183207 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:36.192490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:36.194421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:36.195857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c2bc06ad-dceb-4b9e-96ca-1d7f9f448f21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.238997 Nov 22 22:59:36.196579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 64/133] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:35 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:36.667935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:36.668550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:36.675258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:36.675703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:36.676635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:36.677075 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:36.697235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:36.698555 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:36.705016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:36.705466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:36.706444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:36.706904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:36.894778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:36.902276 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1eb8059f-e6d6-4ceb-9eae-887ad3b6c0bc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.239689 Nov 22 22:59:36.902680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:36.903144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 70/134] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:36 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:36.910410 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2fbd2b88-230a-4407-b9cc-0578a0c979eb tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.217801 Nov 22 22:59:36.911091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 65/135] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:36 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:37.178269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:37.179807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:37.185855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.186307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.187080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.187521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.212992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:37.213609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:37.219460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.219904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.220675 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.221100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.379687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:37.389050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-26cb7753-b463-47bc-9e25-b89853d61dd4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.214519 Nov 22 22:59:37.389823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 71/136] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:37 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:37.407696 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:37.418483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:37.424908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:37.424908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-398b534a-da6a-406b-aceb-4c7fd8732bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.211686 Nov 22 22:59:37.424908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 66/137] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:37 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:37.922590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:37.923372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:37.929672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:37.930300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:37.937911 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.938360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.939148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.939901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.946713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.947309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:37.948547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:37.949025 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:38.172643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:38.180700 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bb66f8d6-988d-401c-bdde-5c114bd929bb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.262364 Nov 22 22:59:38.181296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 72/138] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:37 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:38.200912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:38.207962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f85ae254-ffbb-4c94-b02b-d8f1b237c00b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.283267 Nov 22 22:59:38.208520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 67/139] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:37 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:38.406916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:38.407580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:38.413936 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:38.414396 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:38.415232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:38.415774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:38.439289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:38.439892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:38.447322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:38.447930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:38.449884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:38.450362 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:38.622175 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:38.630765 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9c8e4be6-d18b-4094-9aaa-d19aea982a6e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.227818 Nov 22 22:59:38.631866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 73/140] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:38 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:38.637518 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:38.645480 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:38.647663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:38.648931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-71ceb4ca-c36a-4a10-a4ba-9a4490684cf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.213219 Nov 22 22:59:38.649514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 68/141] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:38 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:39.197368 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:39.197829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:39.203576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.204015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.204809 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.205242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.226039 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:39.226654 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:39.232505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.232879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.233665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.234091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.424808 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:39.429887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:39.432723 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-91b17c5c-df28-4612-bc2d-8016482e3186 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.239158 Nov 22 22:59:39.433427 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 74/142] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:39 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:39.437337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-19e4018c-ffa1-48e7-ac43-d8769a98d326 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.216600 Nov 22 22:59:39.437928 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 69/143] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:39 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:39.648474 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:39.649070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:39.655205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.655657 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.656432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.656855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.667950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:39.668579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:39.675137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.675581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.676396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:39.676827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:39.893202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:39.900639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d3c5636f-abea-44a3-9142-bfd0dbca4e75 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.255839 Nov 22 22:59:39.901410 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 75/144] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:39 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:39.919684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:39.927481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:39.929983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:39.931176 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-56dcbab1-6b39-4ea7-94c5-39fe6245ba65 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.267819 Nov 22 22:59:39.931742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 70/145] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:39 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:40.452378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:40.453556 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:40.455920 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:40.457155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:40.463235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.463685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.464473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.464904 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.466301 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.466956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.467947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.468584 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.730606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:40.743911 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d886fea3-7c93-4f97-891b-f299606270e9 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.291708 Nov 22 22:59:40.744723 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 71/146] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:40 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:40.763962 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:40.776098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2dc91715-e0c3-409a-9679-e3c1f423c31e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.329261 Nov 22 22:59:40.776697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 76/147] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:40 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:40.828500 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-79440b95-d87e-4bf8-83ec-e22f25515f85 req-642fd640-cb82-40e2-a657-10cd95d09d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb", "name": "network-vif-plugged", "status": "completed", "tag": "2003a573-a8f5-4bc2-a99c-24a637138c9a"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:40.831088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:40.831088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 22:59:40.840550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-79440b95-d87e-4bf8-83ec-e22f25515f85 req-642fd640-cb82-40e2-a657-10cd95d09d67 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.841163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-79440b95-d87e-4bf8-83ec-e22f25515f85 req-642fd640-cb82-40e2-a657-10cd95d09d67 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.862018 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-79440b95-d87e-4bf8-83ec-e22f25515f85 req-642fd640-cb82-40e2-a657-10cd95d09d67 service nova] Creating event network-vif-plugged:2003a573-a8f5-4bc2-a99c-24a637138c9a for instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb on hv-cinder-81883 Nov 22 22:59:40.873328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-79440b95-d87e-4bf8-83ec-e22f25515f85 req-642fd640-cb82-40e2-a657-10cd95d09d67 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126902 Nov 22 22:59:40.874132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 72/148] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:40.919208 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:40.919823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:40.927277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.927718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.928650 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.929643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.955680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:40.956679 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:40.967464 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.967907 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:40.968693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:40.969122 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:41.237337 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:41.244989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c24d20ee-5e12-4c4e-8966-4cc02b70e99d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.331343 Nov 22 22:59:41.245563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 77/149] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:40 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:41.311076 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:41.320698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:41.322228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:41.323332 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9b0293d0-2f63-455d-9652-cabbfcd2a8da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.375441 Nov 22 22:59:41.323998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 73/150] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:40 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:41.770306 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:41.773864 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:41.785953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:41.787608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:41.798937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:41.800496 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:41.816995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:41.818611 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:41.828542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:41.829272 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:41.832557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:41.834334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:42.092419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:42.104477 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4a59710e-df50-47a5-8dfe-a9751a91e976 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.343215 Nov 22 22:59:42.105077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 78/151] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:41 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:42.114609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:42.127403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1950a50d-fac3-453e-b113-2e5addece6da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.336493 Nov 22 22:59:42.138001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 74/152] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:41 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:42.263714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:42.264305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:42.273606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:42.275139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:42.277147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:42.277797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:42.343620 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:42.344438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:42.353170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:42.353771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:42.359275 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:42.364105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:42.580462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:42.591395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-67754ea0-0fd8-42bb-9b4c-a7dc847c8cb2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.331886 Nov 22 22:59:42.598463 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 79/153] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:42 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:42.629135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:42.647816 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:42.650292 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:42.651916 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-aa66f84b-e9df-40f6-b138-8c32b596697f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.312454 Nov 22 22:59:42.653365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 75/154] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:42 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:43.121666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:43.122432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:43.133849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.137770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.138949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.139585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.148282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:43.149081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:43.167137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.167583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.168373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.177344 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.431089 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:43.440208 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6574875c-6d51-433b-9e0a-2ef07e964aa0 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1314 microversion: 2.1 time: 0.322220 Nov 22 22:59:43.449556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:43.450846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 80/155] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:43 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:43.458144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cf314011-bed0-444a-93d5-b3ed7c93bb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.315485 Nov 22 22:59:43.458926 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 76/156] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:43 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:43.617751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:43.618363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:43.627724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.628174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.629019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.629423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.679533 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:43.682326 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:43.690062 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.690672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.691600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:43.692153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:43.903604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:43.919550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7d3afe07-04e5-4585-87b1-3b4c2b5bf301 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.304591 Nov 22 22:59:43.920207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 81/157] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:43 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:43.981443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:43.991467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:43.993227 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:43.994370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3ea1d7da-967c-4528-8fa1-adbf8d1dbd66 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.319957 Nov 22 22:59:43.995580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 77/158] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:43 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:44.088754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-50229173-6628-49a7-af8d-2b8b89501769 req-08e252c0-d95c-44c5-a05c-dcc1a56d3fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce09954f-3efe-4542-9eb8-c1be3bc21549", "name": "network-vif-plugged", "status": "completed", "tag": "fa888e86-c386-4687-8daf-0f95de7ce011"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:44.090433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:44.090433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 22:59:44.104662 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-50229173-6628-49a7-af8d-2b8b89501769 req-08e252c0-d95c-44c5-a05c-dcc1a56d3fe2 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.107096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-50229173-6628-49a7-af8d-2b8b89501769 req-08e252c0-d95c-44c5-a05c-dcc1a56d3fe2 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.128463 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-50229173-6628-49a7-af8d-2b8b89501769 req-08e252c0-d95c-44c5-a05c-dcc1a56d3fe2 service nova] Creating event network-vif-plugged:fa888e86-c386-4687-8daf-0f95de7ce011 for instance ce09954f-3efe-4542-9eb8-c1be3bc21549 on hv-cinder-81883 Nov 22 22:59:44.144944 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-50229173-6628-49a7-af8d-2b8b89501769 req-08e252c0-d95c-44c5-a05c-dcc1a56d3fe2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060694 Nov 22 22:59:44.145768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 82/159] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:44.458230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:44.458874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:44.467683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.468301 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.469578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.471572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.478823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:44.482128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:44.501501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.501991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.502821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.503238 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.939339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:44.948970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-27a30ebf-6c53-4f73-9a34-e853050c8c76 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.475377 Nov 22 22:59:44.949689 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 83/160] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:44 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:44.954322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:44.955563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:44.962479 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.963014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:44.963142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.963932 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:44.964484 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:44.976015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9b415521-4226-47ba-a803-c11275d84a00 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1500 microversion: 2.1 time: 0.521512 Nov 22 22:59:44.976751 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 78/161] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:44 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:45.013711 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:45.014577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:45.026167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:45.030205 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:45.031257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:45.032332 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:45.291028 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:45.306207 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:45.309844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:45.316366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-eee3d9e6-1ea6-41f2-8597-3d2204cf787e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.305336 Nov 22 22:59:45.318070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:45.319061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 79/162] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:45 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:45.328878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-67d22a25-869c-492f-8bf3-50c010ee26ce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.377800 Nov 22 22:59:45.330366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 84/163] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:44 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:45.965821 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:45.967055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:45.978236 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:45.978699 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:45.979652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:45.980113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.181957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13394410-ae52-4acb-8d11-e061a4ae89a3", "name": "network-vif-plugged", "status": "completed", "tag": "00b76964-7845-4ede-805d-663e9d646d8b"}, {"server_uuid": "51cf0f00-ab35-48da-bd27-6fba3194dcff", "name": "network-vif-plugged", "status": "completed", "tag": "4d61dd9a-fb6c-4061-9f0b-4ccda1fd6948"}, {"server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "name": "network-vif-plugged", "status": "completed", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:46.184087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:46.184087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 22:59:46.208934 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.211796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.242726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] Creating event network-vif-plugged:00b76964-7845-4ede-805d-663e9d646d8b for instance 13394410-ae52-4acb-8d11-e061a4ae89a3 on hv-cinder-81883 Nov 22 22:59:46.243240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] Creating event network-vif-plugged:4d61dd9a-fb6c-4061-9f0b-4ccda1fd6948 for instance 51cf0f00-ab35-48da-bd27-6fba3194dcff on hv-cinder-81883 Nov 22 22:59:46.243740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] Creating event network-vif-plugged:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 22:59:46.265230 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-200bd4b4-45a3-4e24-8293-71ea4c3602f1 req-bc56a96b-c3ce-49e1-b2cc-ea277ea24385 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.088037 Nov 22 22:59:46.266310 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 85/164] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:46 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:59:46.306048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:46.316493 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3d52219a-7443-4200-a641-a45bccf43828 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.354223 Nov 22 22:59:46.317274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 80/165] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:45 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:46.344369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:46.358100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:46.360002 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:46.368943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:46.376921 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.377980 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.379380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.380014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.395600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.398808 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.401946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.404225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.889945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:46.904377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:46.904595 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:46.908226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:46.909408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-246910a8-cb09-4d55-8a13-4535576bb12e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.576762 Nov 22 22:59:46.910056 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 86/166] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:46 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:46.916957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dac9bd3-ed27-4c32-b4ed-61f823808757"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:46.918929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:46.924575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-72f12475-5b8c-4a2f-9553-ebda62032041 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1362 microversion: 2.1 time: 0.578382 Nov 22 22:59:46.925482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 81/167] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:46 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:46.927262 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.927711 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:46.928707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:46.929136 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:47.334765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:47.335929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:47.342173 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:47.342859 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:47.343976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:47.344786 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:47.612421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:47.621600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7d25205e-5c29-483b-bff1-ab1859fa823b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.290902 Nov 22 22:59:47.622771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 82/168] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:47 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:47.928803 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:47.929513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:47.935918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:47.936489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:47.937652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:47.938368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.087110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:48.094934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:48.096411 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:48.097501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0be144a6-6bbb-4993-a59c-b07912580a19 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.172873 Nov 22 22:59:48.098083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 83/169] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:47 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 22:59:48.103867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:48.104622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:48.111053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:48.111497 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.112289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:48.112766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.245837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:48.253101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-10610339-fbe8-437d-98e0-60cfaaa3bfe5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1549 microversion: 2.1 time: 0.154083 Nov 22 22:59:48.253678 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 84/170] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:48 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:48.270732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:48.271216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:48.278304 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:48.278779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.279589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:48.280019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.406861 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a074179a-eefe-4e1b-b362-da1e6145f626 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140155 Nov 22 22:59:48.407456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 85/171] 10.222.0.81 () {58 vars in 1274 bytes} [Mon Nov 22 22:59:48 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 22:59:48.644163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:48.644799 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:48.651091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:48.651539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.652458 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:48.652935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:48.989606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:49.005368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0e0f12d7-31c3-40ae-8af9-db447af96b4b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.366075 Nov 22 22:59:49.016110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 86/172] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:48 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:49.118986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:49.119995 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:49.127444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:49.128077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:49.129132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:49.129563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:49.660969 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:49.665423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:49.667206 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:49.668319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-df0fc163-3c47-49c4-8302-6ef2ad60502c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.553276 Nov 22 22:59:49.669201 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 87/173] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:49 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:50.023510 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:50.024421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:50.030665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:50.031146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:50.032111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:50.032554 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:50.170194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:50.177538 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-798bf53e-ad12-4f34-a032-29b8b85b38a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.158213 Nov 22 22:59:50.178686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 88/174] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:50 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:50.183065 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:50.184066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:50.190732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:50.191175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:50.191941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:50.192367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:51.454924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b8363b0a-9d3a-4e4e-a9ba-43076433d338 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 1.275019 Nov 22 22:59:51.456527 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 89/175] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:50 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:51.462442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-bcae0f85-be0d-4a71-98c5-2633e6bbd5ce req-dda557de-a76c-483c-a025-9ff8de31bf6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce09954f-3efe-4542-9eb8-c1be3bc21549", "tag": "fa888e86-c386-4687-8daf-0f95de7ce011"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:51.464793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:51.464793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 22:59:51.474523 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-bcae0f85-be0d-4a71-98c5-2633e6bbd5ce req-dda557de-a76c-483c-a025-9ff8de31bf6c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:51.476418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-bcae0f85-be0d-4a71-98c5-2633e6bbd5ce req-dda557de-a76c-483c-a025-9ff8de31bf6c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:51.495501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-bcae0f85-be0d-4a71-98c5-2633e6bbd5ce req-dda557de-a76c-483c-a025-9ff8de31bf6c service nova] Creating event network-changed:fa888e86-c386-4687-8daf-0f95de7ce011 for instance ce09954f-3efe-4542-9eb8-c1be3bc21549 on hv-cinder-81883 Nov 22 22:59:51.503425 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-bcae0f85-be0d-4a71-98c5-2633e6bbd5ce req-dda557de-a76c-483c-a025-9ff8de31bf6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044846 Nov 22 22:59:51.504331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 90/176] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:51.513273 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:51.515417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:51.523298 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:51.524083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:51.525548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:51.526045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:51.570129 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4019375f-cb37-41a9-8449-7a9ee039e203 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "POST /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.658771 Nov 22 22:59:51.576402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 87/177] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 22:59:46 2021] POST /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb/os-volume_attachments => generated 194 bytes in 4666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:51.592132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:51.592132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:51.604817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:51.606497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:51.608707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:51.618874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:51.869782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:51.883015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:51.884426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:51.885688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b98f3072-047a-4728-97f1-25017624e0a2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.379966 Nov 22 22:59:51.886116 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 91/178] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:51 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:51.934417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:51.945210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ff100063-5d24-415c-985b-85624523dd02 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.367379 Nov 22 22:59:51.945842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 88/179] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:51 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:52.467257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:52.469221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:52.476677 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:52.477343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:52.478787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:52.479413 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:52.711024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-47474783-aa4c-40fa-90a3-12c8830da81f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.247232 Nov 22 22:59:52.711857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 92/180] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:52 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:52.904618 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:52.905226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:52.915273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:52.916011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:52.917256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:52.919833 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:52.963620 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:52.964450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:52.971994 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:52.972606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:52.973347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:52.974177 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:53.237202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:53.248343 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:53.250869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:53.252491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-45877413-150f-4b35-9704-b90e79c54dde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.351914 Nov 22 22:59:53.253564 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 89/181] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:52 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:53.287083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:53.297344 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a460cae3-baff-495f-a024-34851761e4a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1322 microversion: 2.1 time: 0.338076 Nov 22 22:59:53.301696 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 93/182] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:52 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:53.723632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:53.724390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:53.731924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:53.732708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:53.733630 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:53.734178 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.024172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1d5f69de-3e73-4a59-80ce-a7db82c82b12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.306621 Nov 22 22:59:54.027563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 90/183] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:53 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:54.273967 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:54.275384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:54.286573 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.287075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.288284 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.288934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.320493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:54.321411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:54.333839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.335751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.336763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.337589 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.548242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:54.561181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:54.564228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:54.565391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4266b8dc-f0db-478d-8912-f68bb08a6325 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1406 microversion: 2.20 time: 0.297258 Nov 22 22:59:54.566369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 94/184] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:54 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:54.601429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:54.609959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f03f2a1a-4a28-4ca1-b556-1eed2917093c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1515 microversion: 2.1 time: 0.296957 Nov 22 22:59:54.623464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 91/185] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:54 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1515 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:54.630858 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:54.632398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:54.641131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.641875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.642835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.643477 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.672883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lazy-loading 'flavor' on Instance uuid 13394410-ae52-4acb-8d11-e061a4ae89a3 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 22:59:54.864481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6e977ef3-2ab5-47d0-9710-1b1ca807de5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3/action" status: 200 len: 32 microversion: 2.1 time: 0.238356 Nov 22 22:59:54.870187 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 95/186] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:54 2021] POST /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:54.883900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:54.885783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:54.902812 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.906891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:54.910114 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:54.913171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:55.035101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:55.040568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:55.058094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:55.058904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:55.059934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:55.060822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:55.171820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-efd17000-6533-4beb-8fc8-e2d67ea73c84 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.140432 Nov 22 22:59:55.172920 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 96/187] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:55 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 22:59:55.228398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:55.239102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7dc7f078-6151-4e70-ab22-832816f7b60c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.367872 Nov 22 22:59:55.246733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 92/188] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:54 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:55.588239 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:55.591100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:55.610874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:55.611644 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:55.613007 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:55.613605 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:55.908698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:55.920498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:55.922776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:55.923950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c232e0a7-0124-4da7-9645-e06ea1fa2b70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1598 microversion: 2.20 time: 0.343026 Nov 22 22:59:55.924590 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 97/189] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 22:59:55 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1598 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 22:59:55.945485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:55.953363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:55.963174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:55.963636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:55.964885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:55.965528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:56.089377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bd19921a-60b6-43b5-ad6d-429d240003fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.148388 Nov 22 22:59:56.089959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 93/190] 10.222.0.81 () {60 vars in 1315 bytes} [Mon Nov 22 22:59:55 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 22:59:56.183972 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:56.184950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:56.195244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:56.195688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:56.196484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:56.196917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:56.263389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:56.263927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:56.270130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:56.270576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:56.271423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:56.271829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:56.330788 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b8832cd4-5145-485a-a4c6-1b2842bca088 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.150351 Nov 22 22:59:56.332184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 98/191] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:56 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:56.534743 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:56.546221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-25df2698-aedd-4a81-a707-27b63a37e2ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.286431 Nov 22 22:59:56.547966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 94/192] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:56 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:57.344269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:57.345363 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:57.369244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:57.372489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:57.381280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:57.384065 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:57.572714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:57.573416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:57.581257 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:57.581730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:57.582514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:57.582955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:57.590158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c4bbc162-2779-4eee-a6cf-c82390eac394 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.250734 Nov 22 22:59:57.593574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 99/193] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:57 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:58.060917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:58.071313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-353b59a7-8710-4d97-a646-e6fa2ea88887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.502934 Nov 22 22:59:58.082221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 95/194] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:57 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 22:59:58.426115 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:58.429995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-60e14de1-a190-422e-895e-c021085a1de8 req-973376ef-de94-436b-99d4-d99697694057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:58.431715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 22:59:58.431715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 22:59:58.446622 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-60e14de1-a190-422e-895e-c021085a1de8 req-973376ef-de94-436b-99d4-d99697694057 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:58.447054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-60e14de1-a190-422e-895e-c021085a1de8 req-973376ef-de94-436b-99d4-d99697694057 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:58.454374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:58.474378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-60e14de1-a190-422e-895e-c021085a1de8 req-973376ef-de94-436b-99d4-d99697694057 service nova] Creating event network-changed:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 22:59:58.482279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-60e14de1-a190-422e-895e-c021085a1de8 req-973376ef-de94-436b-99d4-d99697694057 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058733 Nov 22 22:59:58.484649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 96/195] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 22:59:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 22:59:58.498195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:58.498651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:58.499669 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:58.500117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:58.603193 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:58.605663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:58.613904 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:58.617157 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:58.619393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:58.620701 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:58.645337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-76730349-c537-48b2-bb3f-869ce0051866 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 14 microversion: 2.20 time: 0.237714 Nov 22 22:59:58.647086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 100/196] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 22:59:58 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:58.763846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-83ddd0d7-927e-4900-9c9a-ab03bfdf3cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.165516 Nov 22 22:59:58.770831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 97/197] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:58 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 22:59:59.094048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 22:59:59.095165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:59.103465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:59.104192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:59.105669 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:59.106299 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:59.283631 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 22:59:59.293193 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-51bab2ed-0dfe-405f-8624-0af2770fa5b9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.203691 Nov 22 22:59:59.294781 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 101/198] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 22:59:59 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:59.656973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:59.658058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:59.666606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:59.667311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:59.668267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:59.668692 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:59.777750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 22:59:59.780003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 22:59:59.803224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4f9f3214-ba49-4168-91ef-e84eaa66d117 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 14 microversion: 2.20 time: 0.149863 Nov 22 22:59:59.804035 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:59.804163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 98/199] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 22:59:59 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 22:59:59.809607 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:59.811623 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 22:59:59.812624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 22:59:59.975785 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3d325b6c-f599-430f-89d1-b4b2684c3e27 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.202532 Nov 22 22:59:59.981683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 102/200] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 22:59:59 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:00:00.312536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:00.313226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:00.322952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:00.323400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:00.324245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:00.324603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:00.533478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:00.542542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-619fc510-02ac-4cc4-aabd-be857489fa98 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.233840 Nov 22 23:00:00.543299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 99/201] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:00 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:00.815693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:00.816680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:00.824679 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:00.825122 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:00.825931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:00.826359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:00.987994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:00.988963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:00.996207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:00.996813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:00.997560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:00.998023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:01.347924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-322ae575-f6e5-498a-946f-961658051a15 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 14 microversion: 2.1 time: 0.363374 Nov 22 23:00:01.348586 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 100/202] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:00 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 14 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 23:00:01.378421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-aacfbd65-d114-4533-ba6e-445fe8fa225e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 14 microversion: 2.20 time: 0.565984 Nov 22 23:00:01.382454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 103/203] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:00 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 14 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:01.560054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:01.560833 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:01.567310 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:01.567749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:01.568521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:01.568949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:01.704150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:01.713129 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3792a350-a72c-4a83-b21f-9f6da729d95c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.156790 Nov 22 23:00:01.713950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 101/204] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:01 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:02.363881 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:02.364873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:02.373405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:02.373873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:02.374652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:02.375079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:02.391290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:02.393028 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:02.400038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:02.400684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:02.401513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:02.402171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:06.242898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-751d59a4-27e7-4eaa-948c-e3973f06f114 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 18356 microversion: 2.1 time: 3.882654 Nov 22 23:00:06.243471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 104/205] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:02 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 18356 bytes in 3884 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:06.248517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:06.249199 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:06.257409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:06.257847 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:06.258760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:06.259191 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:06.271156 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-44328f8c-084b-4a19-8356-376254d1e261 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 14 microversion: 2.20 time: 3.884565 Nov 22 23:00:06.275307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 102/206] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:02 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 14 bytes in 3889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:06.404064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:06.412442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-15932045-649a-4a81-83b7-d83e374e63e1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.166991 Nov 22 23:00:06.413009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 105/207] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:06 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:07.254691 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:07.256352 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:07.264221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.264632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.265440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.265919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.282556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:07.283471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:07.290309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.291094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.291889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.292429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.411950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3980a37c-e91e-40e6-8eff-8418db801241 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 19342 microversion: 2.1 time: 0.161095 Nov 22 23:00:07.412935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 103/208] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:07 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 19342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:07.430365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:07.431082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:07.438674 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.439139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.439992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.440450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.461303 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6092f004-53b3-4f64-bb1b-a557ab781e12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 14 microversion: 2.20 time: 0.182247 Nov 22 23:00:07.465109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 106/209] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:07 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:07.588959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:07.596872 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c5a102c4-5a52-458a-b5a1-aca7e5d79c6f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.171200 Nov 22 23:00:07.597423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 104/210] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:07 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:07.920667 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:07.921369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:07.929800 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.930332 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.931208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:07.931690 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:07.963498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:00:08.075922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2000f2e3-8bd1-4e04-8cb6-198d90d17f28 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 204 len: 0 microversion: 2.1 time: 0.159240 Nov 22 23:00:08.076584 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 107/211] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:00:07 2021] DELETE /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:00:08.084958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:08.085607 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:08.099161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.099161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.099161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.099161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.236383 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:08.246039 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2ce52c7f-88fd-4045-971e-aa2fe2f2d33a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1552 microversion: 2.1 time: 0.165007 Nov 22 23:00:08.246641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 105/212] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:08 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:08.424786 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:08.425819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:08.432834 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.433282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.434093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.434532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.472232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:08.473323 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:08.480562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.481011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.481839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.482273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.588961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-411bfb92-fa42-422e-ac8d-06fc7fd704ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 21715 microversion: 2.1 time: 0.167994 Nov 22 23:00:08.589640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 108/213] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:08 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 21715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:08.613804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-30da9f7b-236c-41aa-8cab-475471364330 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 14 microversion: 2.20 time: 0.145012 Nov 22 23:00:08.617710 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 106/214] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:08 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:08.617848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:08.618347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:08.626137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.626521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.627309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:08.627743 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:08.769745 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:08.777808 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-dd56adce-593d-4950-ad15-410a3be186eb tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.165473 Nov 22 23:00:08.778372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 109/215] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:08 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:09.265676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:09.266344 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:09.274469 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:09.275070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:09.275805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:09.276111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:09.413637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:09.421753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d2a517bc-6cf0-4e84-b61c-e430d425395e tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1552 microversion: 2.1 time: 0.160425 Nov 22 23:00:09.422315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 107/216] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:09 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:09.600507 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:09.601528 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:09.608378 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:09.608827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:09.609600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:09.610081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:09.625312 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:09.626287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:09.633554 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:09.634034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:09.634816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:09.635249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:13.946905 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7a8c1240-544d-4cdb-87fc-26ae1f63803b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 24480 microversion: 2.1 time: 4.349776 Nov 22 23:00:13.947553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 110/217] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:09 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 24480 bytes in 4351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:13.952459 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:13.953185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:13.962640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:13.963089 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:13.963952 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:13.964385 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:13.994618 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-78ee236e-dbf4-4276-9806-c8c945cd64a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 11207 microversion: 2.20 time: 4.372429 Nov 22 23:00:13.995495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 108/218] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:09 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 11207 bytes in 4375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:00:14.000690 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:14.001384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:14.009185 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:14.009658 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:14.010454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:14.010886 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:14.131388 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:14.140924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-84c10147-3bab-4d58-85f0-106b4fc238a9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.192131 Nov 22 23:00:14.141492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 111/219] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:13 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:14.189241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:14.198101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6be0aacd-1ba0-46f8-a9b5-856ba8011b2b tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1552 microversion: 2.1 time: 0.201068 Nov 22 23:00:14.198604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 109/220] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:13 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:14.958912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:14.959911 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:14.966322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:14.966768 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:14.967542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:14.967972 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:15.006704 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:15.007613 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:15.014489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:15.014939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:15.015727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:15.016164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:20.209248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-82000a9c-a241-476a-8ab2-3f3b99ad83e3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 19342 microversion: 2.20 time: 5.206433 Nov 22 23:00:20.210035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 110/221] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:15 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 19342 bytes in 5208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:00:20.214528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:20.215207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:20.222801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:20.223241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:20.224167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:20.224598 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:20.256402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-93a9a830-6ca7-473b-b7a8-0eb94e4b1517 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 27764 microversion: 2.1 time: 5.300633 Nov 22 23:00:20.257876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 112/222] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:14 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 27764 bytes in 5304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:20.262822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:20.263518 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:20.272139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:20.272514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:20.273336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:20.273835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:20.410337 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:20.418726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1c2a2175-61df-48b0-8086-e109301476ea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.207778 Nov 22 23:00:20.419309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 111/223] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:20 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:20.456522 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:20.465731 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-072b84db-0252-4e18-a981-caa88901ef07 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1552 microversion: 2.1 time: 0.206605 Nov 22 23:00:20.466620 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 113/224] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:20 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:21.221033 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:21.221891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:21.228699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.229188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.229996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.230436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.268950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:21.270027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:21.279558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.280009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.280811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.281251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.398425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-54f7214d-7743-4a18-817d-35f47c59a7d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 23803 microversion: 2.20 time: 0.180944 Nov 22 23:00:21.399100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 112/225] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:21 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 23803 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:21.436534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:21.437225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:21.444857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.445297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.446088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.446518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.466051 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ec09ae61-a124-4f10-96a7-e2e8795b8174 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 27861 microversion: 2.1 time: 0.201016 Nov 22 23:00:21.466719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 114/226] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:21 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 27861 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:21.486654 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:21.487321 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:21.495598 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.496083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.496934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:21.497406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:21.618083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:21.625835 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2172fb44-6d0f-4dcc-a22e-f4677b0578d4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.193265 Nov 22 23:00:21.626404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 113/227] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:21 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:21.667757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:21.675945 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-981f1f2e-bfeb-4f16-a4d6-09c68e06d076 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1552 microversion: 2.1 time: 0.193384 Nov 22 23:00:21.676666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 115/228] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:21 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:22.256473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-5471ddaf-04e0-45e1-b17e-74f20ede8552 req-f92c24b3-0707-48ce-a8c5-d528577c63b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb", "name": "network-vif-deleted", "tag": "2003a573-a8f5-4bc2-a99c-24a637138c9a"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:22.261251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:00:22.261251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:00:22.269808 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-5471ddaf-04e0-45e1-b17e-74f20ede8552 req-f92c24b3-0707-48ce-a8c5-d528577c63b6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.270237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-5471ddaf-04e0-45e1-b17e-74f20ede8552 req-f92c24b3-0707-48ce-a8c5-d528577c63b6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.283258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-5471ddaf-04e0-45e1-b17e-74f20ede8552 req-f92c24b3-0707-48ce-a8c5-d528577c63b6 service nova] Creating event network-vif-deleted:2003a573-a8f5-4bc2-a99c-24a637138c9a for instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb on hv-cinder-81883 Nov 22 23:00:22.288829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-5471ddaf-04e0-45e1-b17e-74f20ede8552 req-f92c24b3-0707-48ce-a8c5-d528577c63b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037764 Nov 22 23:00:22.289660 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 114/229] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:00:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:00:22.410736 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:22.412044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:22.419091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.419543 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.420334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.420778 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.478699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:22.479830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:22.486260 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.486986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.488084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.488524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.535277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-010b0bf2-66f5-4cf6-9045-9ce7c245b301 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 24782 microversion: 2.20 time: 0.128486 Nov 22 23:00:22.536054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 116/230] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:22 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 24782 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:22.624144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a1d2eaec-8046-4330-a00b-c6922a8873c4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 27988 microversion: 2.1 time: 0.149330 Nov 22 23:00:22.628064 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 115/231] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:22 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 27988 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:00:22.643433 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:22.644138 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:22.652127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.652646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.653461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.653926 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.706212 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:22.707504 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:22.717794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.718531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.719469 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:22.720152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:22.799035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:22.811018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-84185355-20fe-40b9-94d6-85ff9a628008 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1345 microversion: 2.1 time: 0.108662 Nov 22 23:00:22.811613 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 116/232] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:22 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:22.841588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:22.849971 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5f1dc433-829a-4482-bede-e0955b51a548 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.210259 Nov 22 23:00:22.850808 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 117/233] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:22 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:23.547669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:23.548576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:23.555647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:23.556086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:23.556843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:23.557270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:23.635805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:23.636741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:23.642990 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:23.643440 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:23.644254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:23.644733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:28.215151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-60c11489-ef2d-4ca9-8598-e884dee04501 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 27691 microversion: 2.20 time: 4.670987 Nov 22 23:00:28.215798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 117/234] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:23 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 27691 bytes in 4673 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:28.220697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:28.221391 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:28.230829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:28.231314 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:28.232165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:28.232606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:28.298662 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:28.307889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1ab9a041-32db-4478-b25c-803ab4316a0f tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1345 microversion: 2.1 time: 0.090828 Nov 22 23:00:28.308459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 118/235] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:28 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:28.312628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:28.313229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:28.319636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:28.320102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:28.320900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:28.321395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:28.324259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-23bae5c9-5a66-4b42-9ed5-8c5d5b2f21c3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 27988 microversion: 2.1 time: 4.691921 Nov 22 23:00:28.325588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 118/236] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:23 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 27988 bytes in 4694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:00:28.455163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:28.463014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-87da7c56-59d8-475b-936e-d753e5d6fa93 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.153542 Nov 22 23:00:28.463591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 119/237] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:28 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:29.227679 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:29.228670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:29.235590 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.236032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.236988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.237234 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.323825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:29.324498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:29.332485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.333473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.334551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.334988 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.347495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-790b3b41-08e0-45a9-aa30-4abdd6eb0cc5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 27726 microversion: 2.20 time: 0.124439 Nov 22 23:00:29.350184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 119/238] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:29 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 27726 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:29.357107 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:29.358373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:29.367075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.367845 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.369052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.369681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.415073 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cc3cbc289d42388c931ca501263c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae3b6b7cb754497a30d3a41220bef60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:29.423641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bcfbe111-0dd3-4a2e-ad09-5bb91fad412a tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 200 len: 1345 microversion: 2.1 time: 0.103225 Nov 22 23:00:29.424393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 120/239] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:29 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:29.482320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:29.483341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:29.490444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.491139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.492058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:29.492705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:29.499771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5795c887-43b3-48af-b7e9-34a29ec12619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28039 microversion: 2.1 time: 0.146583 Nov 22 23:00:29.500753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 120/240] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:29 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28039 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:29.666542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:29.673954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9f0ec5d3-5616-4efd-9ed7-c142dd25c1f0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.197597 Nov 22 23:00:29.674436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 121/241] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:29 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:30.360777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:30.361773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:30.368666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.369113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.369908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.370340 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.441098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:30.441737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:30.448927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.449382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.450185 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.450621 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.464707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] HTTP exception thrown: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. Nov 22 23:00:30.465300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Returning 404 to user: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:00:30.466165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fef5f1d1-5dbb-459d-ba3c-b5e662222b80 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 404 len: 111 microversion: 2.1 time: 0.028728 Nov 22 23:00:30.466704 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 122/242] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:30 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 23:00:30.484330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cfc00af2-2df8-4503-92d9-3f71061b29c9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 27792 microversion: 2.20 time: 0.127301 Nov 22 23:00:30.485052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 121/243] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:30 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 27792 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:00:30.555685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:30.560599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:30.567062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.568414 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.569200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.569640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.572095 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:30.573100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:30.579962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.580414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.581197 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.581645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.595269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] HTTP exception thrown: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. Nov 22 23:00:30.596063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Returning 404 to user: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:00:30.596895 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-652ce671-2ef9-4d1b-a4be-e26f1c57d584 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030140 Nov 22 23:00:30.601460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 122/244] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:00:30 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 23:00:30.694169 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:30.695188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:30.701779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.702294 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.703517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:30.703979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:30.725715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fd02ee41-b6b2-462e-ab68-6bf611408511 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28106 microversion: 2.1 time: 0.173837 Nov 22 23:00:30.726792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 123/245] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:30 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28106 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:30.867288 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:30.874855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f2085af8-1292-49a0-8f4d-289b3a4a06fa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.187036 Nov 22 23:00:30.875569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 123/246] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:30 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:31.497054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:31.498308 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:31.512064 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.512511 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.513300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.513761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.635314 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-79f4fe01-578b-4461-a3ef-9f2371eba1b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 27907 microversion: 2.20 time: 0.141615 Nov 22 23:00:31.636504 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 124/247] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:31 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 27907 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:31.740683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:31.741850 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:31.748677 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.749388 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.750213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.750877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.874249 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4ec9eadf-e716-4bb0-a3dc-7ee32c9cce41 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.140017 Nov 22 23:00:31.875237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:31.875530 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 124/248] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:31 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:31.876232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:31.884061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.884789 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.885832 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.886450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.892907 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:31.893935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:31.902123 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.902831 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.903771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.904059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] HTTP exception thrown: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. Nov 22 23:00:31.904539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.904768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Returning 404 to user: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:00:31.905550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6121214e-34f7-43e7-b7cf-41535c1584a2 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 404 len: 111 microversion: 2.1 time: 0.036852 Nov 22 23:00:31.906639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 125/249] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:00:31 2021] DELETE /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 23:00:31.914843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:31.915910 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] [instance: 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:31.926666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.927232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.928196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:31.928694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:31.945425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] HTTP exception thrown: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. Nov 22 23:00:31.947227 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] Returning 404 to user: Instance 7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:00:31.948154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5184db05-09fa-4490-839a-2941f84dc739 tempest-DeleteServersTestJSON-1099926565 tempest-DeleteServersTestJSON-1099926565-project] 10.222.0.81 "GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb" status: 404 len: 111 microversion: 2.1 time: 0.037800 Nov 22 23:00:31.949076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 126/250] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:31 2021] GET /compute/v2.1/servers/7dbaecb1-8b97-4a9a-aca9-6157d2cd40bb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:00:32.093684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:32.107793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-40d53ae4-4542-483e-9db2-23c12d422cb3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.218946 Nov 22 23:00:32.108389 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 125/251] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:31 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:32.690770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:32.691703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:32.701460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:32.702458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:32.703800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:32.705361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:32.820502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e38fb78f-05b9-44d1-ac4a-52f5fa08180f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28035 microversion: 2.20 time: 0.133283 Nov 22 23:00:32.821727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 127/252] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:32 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:32.886406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:32.887355 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:32.897889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:32.898354 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:32.900329 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:32.900774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:33.006201 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a37c349d-f8d9-4826-93ce-183ec07b6e86 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.122422 Nov 22 23:00:33.007158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 126/253] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:32 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:33.126328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:33.127037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:33.134543 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:33.135219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:33.136013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:33.136447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:33.413491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:33.423540 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-66b03b9f-3de9-442a-980e-0406c9293749 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.301665 Nov 22 23:00:33.424593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 128/254] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:33 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:33.833322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:33.834571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:33.842196 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:33.842883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:33.844735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:33.845235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:33.955497 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bd8146f5-f58e-488f-88b0-87452383a96c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.126639 Nov 22 23:00:33.960114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 127/255] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:33 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:34.016945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:34.018709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:34.026486 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:34.027296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:34.028431 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:34.029007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:34.120787 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3588a36f-b52b-4198-a030-92bbaabb9051 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.107141 Nov 22 23:00:34.122263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 129/256] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:34 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:34.442539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:34.443823 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:34.450733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:34.451625 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:34.452603 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:34.453222 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:34.612469 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:34.623724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a3601036-cbdc-4a0a-8bf3-74242236ff4e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.185142 Nov 22 23:00:34.624830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 128/257] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:34 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:34.977203 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:34.981764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:35.002822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:35.003436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:35.004757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:35.005534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:35.103842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ea20b807-0ddc-4832-a04b-f34642098e10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.138875 Nov 22 23:00:35.104409 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 130/258] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:34 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:35.133544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:35.135238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:35.142065 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:35.142515 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:35.143712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:35.144476 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:35.252748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-63a56e56-382a-41a7-a47d-1c23b9debe2e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.123149 Nov 22 23:00:35.253868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 129/259] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:35 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:35.647173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:35.648044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:35.655822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:35.656522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:35.657596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:35.658695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:35.840658 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:35.847961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f11e9021-bba5-498a-bea0-9dc760fd5dea tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.209095 Nov 22 23:00:35.848684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 131/260] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:35 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:36.118449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:36.119825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:36.127355 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:36.127810 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:36.128596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:36.129030 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:36.247181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9ac27773-e876-4d4a-8653-0c280c353e0e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.133897 Nov 22 23:00:36.248248 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 130/261] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:36 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:36.265038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:36.266100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:36.272544 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:36.273012 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:36.274013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:36.274447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:36.387950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e95db67a-abae-4d3b-82a1-060129f0e5ee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.125696 Nov 22 23:00:36.389988 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 132/262] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:36 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:36.877414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:36.878163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:36.890266 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:36.890719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:36.891712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:36.892175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:37.073038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:37.083543 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a329b527-cf22-4d6c-a96d-f527a9185254 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.221174 Nov 22 23:00:37.084376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 131/263] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:36 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:37.260043 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:37.261046 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:37.267918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:37.269039 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:37.271308 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:37.272003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:37.376246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-80cf6d9d-e82e-439b-be6a-7dd1c2602de8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.120268 Nov 22 23:00:37.376898 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 133/264] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:37 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:37.400782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:37.402398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:37.410498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:37.411482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:37.412298 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:37.412936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:37.535120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f378039b-1309-496f-a1cc-0659adfd7573 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.138047 Nov 22 23:00:37.539021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 132/265] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:37 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:38.101458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:38.102494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:38.113011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:38.114455 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:38.115592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:38.116225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:38.304784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:38.314362 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ee9e4c2f-d587-4952-a044-5d987b25802c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.217211 Nov 22 23:00:38.315317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 134/266] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:38 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:38.390238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:38.391234 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:38.400632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:38.401117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:38.401900 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:38.402315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:38.504124 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e627fefe-4b62-4a7e-92a3-3eed5a661292 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.118089 Nov 22 23:00:38.505771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 133/267] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:38 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:38.547876 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:38.548817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:38.555573 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:38.556268 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:38.557441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:38.558029 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:38.939030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2800ba42-d4be-4426-9ab7-68617c176349 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.394529 Nov 22 23:00:38.940070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 135/268] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:38 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:00:39.332425 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:39.334177 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:39.351547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:39.354401 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:39.356756 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:39.358271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:39.519385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:39.521884 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:39.536341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:39.543984 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:39.545127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:39.545678 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:39.781330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:39.793526 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-789d3b02-778c-4116-b687-839abc7f9445 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.464991 Nov 22 23:00:39.794146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 134/269] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:39 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:39.951892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:39.952812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:39.960184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:39.960867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:39.962451 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:39.963049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:44.240233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3db6af10-0775-452e-9cd4-cab8afa6784e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 4.725864 Nov 22 23:00:44.245847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 136/270] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:39 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 4734 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:44.256284 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:44.257272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:44.266679 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:44.267939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:44.269101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:44.269642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:44.273244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-196d8e2f-4133-4efb-a0dc-ceb6e3947649 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 4.324792 Nov 22 23:00:44.274769 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 135/271] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:39 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 4327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:00:44.492953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:44.502298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d2aa6db9-e167-43a5-98b5-b265f067f8aa tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.254472 Nov 22 23:00:44.503185 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 137/272] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:44 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:45.264390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:45.268777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:45.302620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:45.304776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:45.318012 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:45.320646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:45.323317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:45.323901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:45.326950 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:45.328687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:45.330211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:45.331968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:45.488001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a0ea1209-39aa-4912-aa44-154ad47cf793 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.238172 Nov 22 23:00:45.494117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 136/273] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:45 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:45.521963 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:45.523008 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:45.540751 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:45.541208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:45.541581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-82af1e04-dd27-4dea-a67f-a442cd6622ea tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.244320 Nov 22 23:00:45.546834 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 138/274] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:45 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:45.548194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:45.548681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:46.255263 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:46.280511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d5115ded-cd20-4a55-892e-0944d4ec17e8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.761566 Nov 22 23:00:46.283199 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 137/275] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:45 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:46.503175 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:46.505530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:46.515553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:46.517154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:46.525160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:46.531369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:46.555670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:46.556691 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:46.578600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:46.582064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:46.583760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:46.584568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:46.697603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-451271c0-6ecd-4a91-b86b-650633914ef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.198470 Nov 22 23:00:46.700314 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 139/276] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:46 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:46.737060 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6cce4beb-2b26-452f-b8a8-252be4ee420f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.184265 Nov 22 23:00:46.738195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 138/277] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:46 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:00:47.302235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:47.303593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:47.315674 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:47.316136 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:47.317047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:47.317497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:47.714468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:47.716471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:47.732529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:47.751261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:47.751903 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:47.753429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2d8ef049-79dc-4573-9650-2ec9fe52f835 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.455892 Nov 22 23:00:47.763577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 140/278] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:47 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:47.765805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:47.766699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:47.767674 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:47.771980 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:47.802556 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:47.803007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:47.803812 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:47.810990 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:52.033950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-be47bd9b-6614-43e0-9d66-4ad9cf67899c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 4.325663 Nov 22 23:00:52.041067 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 139/279] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:47 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 4334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:00:52.050627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d2e9f051-eb9c-4ed3-933d-0d714ba6bbe9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 4.293746 Nov 22 23:00:52.055560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 141/280] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:47 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 4298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:52.060785 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:52.074288 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:52.096788 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:52.097445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:52.100356 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:52.101023 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:52.310318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:52.322542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7c33c4e3-3d16-4348-885c-91779da2d813 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.279969 Nov 22 23:00:52.323921 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 140/281] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:52 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:52.542503 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-facb4933-19da-43a2-b627-bde52730eeee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Action: 'create', calling method: .version_select at 0x7fefc999baf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-998649441"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:52.571249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-facb4933-19da-43a2-b627-bde52730eeee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Getting quotas for project f8e29191d83b4af2b4c82ff4194343c7. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:00:52.580604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-facb4933-19da-43a2-b627-bde52730eeee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Getting quotas for user 93034034fa934b7486a203f4783835ad and project f8e29191d83b4af2b4c82ff4194343c7. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:00:52.679224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-facb4933-19da-43a2-b627-bde52730eeee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Getting quotas for project f8e29191d83b4af2b4c82ff4194343c7. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:00:52.685114 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-facb4933-19da-43a2-b627-bde52730eeee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Getting quotas for user 93034034fa934b7486a203f4783835ad and project f8e29191d83b4af2b4c82ff4194343c7. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:00:52.709714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-facb4933-19da-43a2-b627-bde52730eeee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.655885 Nov 22 23:00:52.710572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 142/282] 10.222.0.81 () {60 vars in 1157 bytes} [Mon Nov 22 23:00:52 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:53.047521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:53.049072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:53.057081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:53.057869 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:53.058822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:53.059414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:53.062996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:53.064031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:53.079797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:53.080256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:53.081061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:53.081500 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:53.328370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fc648f91-095a-4320-a2b6-ecb961ae878b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.282701 Nov 22 23:00:53.330265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 141/283] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:53 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:53.341159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:53.342277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:53.352119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:53.352842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:53.354560 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:53.355496 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:53.366021 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6142ec7e-7fee-40e4-b6ff-3c2a9c654c22 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.306377 Nov 22 23:00:53.372097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 143/284] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:53 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:53.652987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:53.674868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3f5528cd-5a9c-4827-b52c-6c870d8b11c2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1521 microversion: 2.1 time: 0.338078 Nov 22 23:00:53.676349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 142/285] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:53 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:53.874102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1d8a4986-9418-496f-a1ef-279eff35c018 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Action: 'create', calling method: .version_select at 0x7fefc9980040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-283226992"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:53.901778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-1d8a4986-9418-496f-a1ef-279eff35c018 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for project 4371c64c75764f9c80faa90370720ae5. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:00:53.926524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-1d8a4986-9418-496f-a1ef-279eff35c018 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for user 4fe1833c77424a2d9ba3d33f1793c9f4 and project 4371c64c75764f9c80faa90370720ae5. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:00:54.264892 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-1d8a4986-9418-496f-a1ef-279eff35c018 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for project 4371c64c75764f9c80faa90370720ae5. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:00:54.278409 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-1d8a4986-9418-496f-a1ef-279eff35c018 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for user 4fe1833c77424a2d9ba3d33f1793c9f4 and project 4371c64c75764f9c80faa90370720ae5. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:00:54.315800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1d8a4986-9418-496f-a1ef-279eff35c018 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.733069 Nov 22 23:00:54.317740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 144/286] 10.222.0.81 () {60 vars in 1157 bytes} [Mon Nov 22 23:00:53 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:00:54.343330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:54.344650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:54.369893 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:54.378332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:54.378683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:54.380246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:54.380431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:54.384738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:54.394036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:54.395725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:54.397955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:54.399221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:54.616125 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a5bf352e-a5b4-464f-9f5e-2f270dfb610d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.241341 Nov 22 23:00:54.616445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 145/287] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:54 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:00:54.636477 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5da2c165-3355-4c59-a8b6-350ea108d5d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.297143 Nov 22 23:00:54.637146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 143/288] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:54 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:54.693357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:54.694442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:54.713152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:54.713152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:54.714030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:54.714395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.087518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:55.098678 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e5002744-e8eb-49ee-9cef-478a8ef753d1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1501 microversion: 2.1 time: 0.409700 Nov 22 23:00:55.100576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 146/289] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:54 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1501 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:55.120587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:00:55.121485 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:55.138459 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:55.139418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.140232 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:55.146280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.627964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:55.637760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:55.643172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:55.644018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.646641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:55.649366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.700853 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:00:55.721478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0bdc317e-44e9-46fd-a6bf-66ebbd269ec3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1515 microversion: 2.1 time: 0.597440 Nov 22 23:00:55.722361 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 144/290] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:00:55 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1515 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:00:55.737715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:55.747485 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:55.774895 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:55.775551 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.776742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:55.777167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:55.857820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d5fdef6a-37ab-41ae-ab5c-fc3973e02542 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.233909 Nov 22 23:00:55.858659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 147/291] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:55 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:55.928867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-94c504cf-e82a-46f0-a9a5-47f73aa6263a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.202829 Nov 22 23:00:55.930348 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 145/292] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:55 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:56.870284 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:56.871543 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:56.887126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:56.887584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:56.888390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:56.888908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:56.941154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:56.942641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:56.965395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:56.966117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:56.967109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:56.967703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:57.055047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-189d77bc-a20d-4345-b620-2acec0d9a87a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.188872 Nov 22 23:00:57.056481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 148/293] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:56 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:00:57.118728 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b8971f76-7362-41fb-b1ff-04ee01df5b87 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.179304 Nov 22 23:00:57.119750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 146/294] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:56 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:00:58.069051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:58.070160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:58.079839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:58.080300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:58.081123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:58.081559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:58.139188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:00:58.140202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:00:58.150172 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:58.150628 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:00:58.151391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:00:58.151818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:01.887401 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cf5ccbe7-eaec-4dd7-99fb-bf72356a8941 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 3.823470 Nov 22 23:01:01.888145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 149/295] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:00:58 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 3825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:02.040942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-33c40853-a413-4458-9ab7-7a72d3abb3dc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 3.913518 Nov 22 23:01:02.045659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 147/296] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:00:58 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 3919 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:02.899508 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:02.900566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:02.912346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:02.912800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:02.913602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:02.914063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:03.008138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e8a2089e-8638-4710-a5e7-7c0d44761eb6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.112385 Nov 22 23:01:03.008939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 150/297] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:02 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:03.054103 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:03.055270 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:03.063364 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:03.063957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:03.065022 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:03.065565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:03.166450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-76a41b4d-350f-4add-ab9f-47f5a306ffb3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.117325 Nov 22 23:01:03.167453 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 148/298] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:03 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:04.021645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:04.022684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:04.029757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:04.030214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:04.031006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:04.031447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:04.179126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:04.180129 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:04.187286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:04.187658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:04.188454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:04.188894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:09.382762 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dbbd2e35-4f8c-45a7-872e-22c95d07f868 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 5.366341 Nov 22 23:01:09.383860 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 151/299] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:04 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 5368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:09.399365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c7f0e7d0-4025-47a7-956d-60cae3a7d264 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 5.224221 Nov 22 23:01:09.403390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 149/300] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:04 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 5226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:10.395281 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:10.396235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:10.403362 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:10.403811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:10.404605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:10.405045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:10.412806 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:10.414135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:10.423228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:10.423681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:10.424484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:10.424918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:10.518769 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8eb213df-263b-4d15-b897-32c41a1a5e97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.127811 Nov 22 23:01:10.520036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 152/301] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:10 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:10.548641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-15051564-5c8d-4b34-aed5-657932992eb8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.140919 Nov 22 23:01:10.549655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 150/302] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:10 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:11.293186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:11.294271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:11.301645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.302222 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.303099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.303648 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.329986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lazy-loading 'flavor' on Instance uuid 51cf0f00-ab35-48da-bd27-6fba3194dcff {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:01:11.448357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6a542aed-21f3-46b7-866a-0d22e4414ad4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action" status: 200 len: 32 microversion: 2.1 time: 0.160781 Nov 22 23:01:11.452739 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 153/303] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:11 2021] POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:01:11.465159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:11.465930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:11.477897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.478359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.479161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.479601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.533212 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:11.534358 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:11.542726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.543180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.544248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.544442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.655150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fa5a2d10-f69b-47d6-9c6b-87434ddfa7ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.126187 Nov 22 23:01:11.655799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 154/304] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:11 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:11.656629 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:11.662942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:11.664232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:11.666673 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-aec67ee3-4bcc-446f-856a-c6cdcfacf4be tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.212365 Nov 22 23:01:11.667306 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 151/305] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:11 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:11.679982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.680431 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.681216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:11.681683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:11.788771 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-08b29f52-b539-45bf-9a39-4a97e1f46249 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.130982 Nov 22 23:01:11.790829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 155/306] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:11 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:12.667308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:12.668331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:12.675129 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:12.675656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:12.676594 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:12.676893 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:12.686517 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:12.687948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:12.697031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:12.697719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:12.698784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:12.699605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:12.834562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:12.842423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1d5e8a80-2fa3-4ebb-aea1-9ce6d75c750d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.160585 Nov 22 23:01:12.843069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 156/307] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:12 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:12.847628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:12.848582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:12.854566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:12.855017 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:12.855797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:12.856227 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:20.548044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-27cbc034-79d3-4fe9-b697-be4b80928236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 7.884447 Nov 22 23:01:20.548599 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 152/308] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:12 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 7886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:20.554003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:20.554684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:20.565710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:20.566282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:20.567820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:20.568259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:20.570212 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-567dbdcd-739d-4959-a5b3-f558ffb706d7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 7.725661 Nov 22 23:01:20.574115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 157/309] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:12 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 7730 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:20.704673 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:20.712406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0d9915bf-70a0-40be-999d-2c9a4bf74d40 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.162743 Nov 22 23:01:20.712956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 153/310] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:20 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:21.562837 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:21.564213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:21.574463 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:21.575059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:21.575605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:21.576037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:21.584405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:21.585377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:21.593291 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:21.594008 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:21.595071 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:21.595559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:21.761541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f9bc1614-10c7-497a-9e3f-4e5bb3c4cd3e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.204111 Nov 22 23:01:21.762210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 158/311] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:21 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:21.766956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:21.767661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:21.775419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:21.775865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:21.776640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:21.777074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:21.801950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ba50c30c-db12-4d57-a2f5-76186532c245 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.222919 Nov 22 23:01:21.802653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 154/312] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:21 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:21.913783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:21.921638 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-caed8e43-2e23-4b56-bcb7-2579283159ff tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.158268 Nov 22 23:01:21.922224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 159/313] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:21 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:22.776047 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:22.777079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:22.784780 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:22.785254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:22.786069 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:22.787152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:22.815559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:22.817411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:22.824348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:22.824884 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:22.825793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:22.826247 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:31.536908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-02e05cc8-728f-49f7-a519-bb8f5f4385f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 8.765602 Nov 22 23:01:31.537686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 155/314] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:22 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 8769 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:31.542446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:31.543142 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:31.549207 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:31.549684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:31.551142 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:31.551649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:31.687308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:31.694695 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cbd26ffc-4d03-4c5e-90bf-99bdfd93b640 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.156071 Nov 22 23:01:31.695249 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 156/315] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:31 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:31.705645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ed8ecaf2-f890-48b5-9a67-674468ccbb12 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 8.894743 Nov 22 23:01:31.707086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 160/316] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:22 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 8897 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:32.550743 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:32.551657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:32.558021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:32.558462 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:32.559247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:32.559676 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:32.671165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4738569b-3447-49f8-ba5f-74b2394d6aa4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.124536 Nov 22 23:01:32.671807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 157/317] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:32 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:32.711450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:32.712201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:32.718961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:32.719236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:32.719687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:32.719973 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:32.720461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:32.720891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:32.727195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:32.727643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:32.728570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:32.729192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:32.852564 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8e28369f-1583-4d49-890a-77f6fbef248b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.137468 Nov 22 23:01:32.853285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 158/318] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:32 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:32.861970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:32.870113 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ba3c9b62-cce3-4536-bd09-d5c0c1045dd8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.162749 Nov 22 23:01:32.870685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 161/319] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:32 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:33.683580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:33.684580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:33.691930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:33.692377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:33.693146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:33.693583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:33.782438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fda80631-1e38-4083-94f4-6346fb76190c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.102698 Nov 22 23:01:33.783078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 159/320] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:33 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:33.864309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:33.865239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:33.871634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:33.872086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:33.872900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:33.873336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:33.887792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:33.888573 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:33.896473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:33.896923 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:33.897736 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:33.898176 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:33.973124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-92ce87f9-4e9b-4a2b-89bc-9a1dd45b0294 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.112402 Nov 22 23:01:33.977635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 162/321] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:33 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:34.041335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:34.051281 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7c276b84-5fb5-4c41-97ed-911efd755af5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.167501 Nov 22 23:01:34.052849 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 160/322] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:33 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:34.795146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:34.796405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:34.804193 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:34.804644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:34.805432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:34.805965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:34.901413 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d588dc47-eca1-44b3-8e3d-9b652ed03236 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.110241 Nov 22 23:01:34.902145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 163/323] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:34 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:34.984954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:34.986397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:34.993871 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:34.994352 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:34.995169 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:34.995615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:35.070195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:35.071218 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:35.078503 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:35.078959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:35.079862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:35.080301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:35.099254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6ea09017-8859-44e7-ad94-8323b3093c4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.118472 Nov 22 23:01:35.100898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 161/324] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:34 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:35.288304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:35.299454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-906a78cc-b870-41a2-bfa0-ad31756bfac0 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.234054 Nov 22 23:01:35.300290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 164/325] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:35 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:35.921941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:35.921941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:35.921941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:35.921941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:35.922617 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:35.923093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:36.036798 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1bc60b19-9d7f-4037-9f07-0ae8686abf11 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.127441 Nov 22 23:01:36.037427 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 162/326] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:35 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:36.110999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:36.111913 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:36.118383 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:36.118736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:36.119498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:36.119908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:36.235469 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b0dc15e4-9527-4e67-bf1c-e0667195f78d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.127973 Nov 22 23:01:36.236107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 165/327] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:36 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:36.317045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:36.317867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:36.325454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:36.326156 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:36.327117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:36.328097 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:36.470864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:36.479135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d8a4c4de-afbc-485a-b3aa-8c116b512a7c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.166601 Nov 22 23:01:36.479717 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 163/328] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:36 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:37.048600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:37.049899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:37.057085 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:37.057547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:37.058369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:37.058809 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:37.248238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:37.249200 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:37.255589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:37.256041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:37.256823 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:37.257256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:40.875914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c3380fb9-7439-4375-9ff3-cdeb678dfe7a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 3.831064 Nov 22 23:01:40.876694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 166/329] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:37 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 3833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:40.881905 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:40.882696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:40.890386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:40.890857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:40.891632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:40.892069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:40.920697 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-46a7e8e5-7df9-4c0f-9038-9936728a20a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 3.676494 Nov 22 23:01:40.924545 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 164/330] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:37 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 3678 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:41.032636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:41.041007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ee8f5384-95af-436b-a298-58fce866d046 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.163228 Nov 22 23:01:41.041568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 167/331] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:40 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:41.888393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:41.889440 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:41.896525 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:41.896969 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:41.897825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:41.898249 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:41.932339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:41.933308 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:41.939782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:41.940428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:41.941348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:41.941866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:41.992238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9c20792b-a604-4fe4-ad4b-a1a95d859869 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.107646 Nov 22 23:01:41.992884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 165/332] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:41 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:42.057850 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:42.058556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:42.068606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:42.069064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:42.069887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:42.070324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:42.079354 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f73bc18e-6277-4109-ae5f-2e15f68399e8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.150602 Nov 22 23:01:42.080181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 168/333] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:41 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:42.200738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:42.208596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0cb8a952-d03a-48e0-ae5a-b963fc2654ec tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.154926 Nov 22 23:01:42.209148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 166/334] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:42 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:43.005211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:43.006251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:43.013196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:43.013670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:43.014460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:43.014896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:43.090719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:43.091648 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:43.099030 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:43.099477 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:43.100261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:43.100698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:43.187975 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e443d999-dd31-4b62-909e-65675e180141 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28223 microversion: 2.1 time: 0.186957 Nov 22 23:01:43.188530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 169/335] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:42 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:43.226403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:43.227096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:43.234027 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:43.234475 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:43.235250 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:43.235742 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:43.257379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2e81ce38-e388-415c-8151-05facc82cdc1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.170138 Nov 22 23:01:43.261425 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 167/336] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:43 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:43.372068 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:43.379473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-28b02b69-665d-44aa-9d6b-77c75c0d8f06 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.157071 Nov 22 23:01:43.380036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 170/337] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:43 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:44.200722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:44.201768 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:44.212437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:44.213119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:44.213938 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:44.214540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:44.268455 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:44.269554 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:44.275985 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:44.276433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:44.277214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:44.277831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:44.328813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d3ea72f3-13d3-481d-a9db-06ea402223a5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28514 microversion: 2.1 time: 0.131852 Nov 22 23:01:44.332999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 168/338] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:44 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28514 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:44.391584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-eb455f85-bcd6-4ad2-be0b-8277f79152d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28150 microversion: 2.20 time: 0.126473 Nov 22 23:01:44.392871 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 171/339] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:44 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28150 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:44.400918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:44.401689 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:44.408663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:44.409699 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:44.410503 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:44.410943 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:44.569182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:44.576506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fa3da991-cecf-4158-b1bf-3f76dfdde91b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.183619 Nov 22 23:01:44.577067 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 169/340] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:44 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:45.341026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:45.342684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:45.351754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:45.352413 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:45.353007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:45.353481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:45.406393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:45.408158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:45.416506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:45.417219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:45.418057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:45.418499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:45.447400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32332a71-b164-4f27-8131-47734858fd7c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28514 microversion: 2.1 time: 0.110325 Nov 22 23:01:45.448862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 172/341] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:45 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28514 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:01:45.527708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f4a9aa80-cdb1-47d1-92a0-6c7bb6febac1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28363 microversion: 2.20 time: 0.124972 Nov 22 23:01:45.528651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 170/342] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:45 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28363 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:45.594745 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:45.595452 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:45.603171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:45.603625 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:45.604450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:45.604893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:45.743974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:45.751235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ac7b766b-68fa-41a9-a188-2ed761cf1f9a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.160591 Nov 22 23:01:45.752147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 173/343] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:45 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:46.461027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:46.464256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:46.471447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:46.471976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:46.472861 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:46.473362 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:46.540325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:46.541367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:46.547681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:46.548130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:46.548994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:46.549447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:46.564042 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fce9b6ec-1ab1-48db-93a8-82ef608e7496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28514 microversion: 2.1 time: 0.106782 Nov 22 23:01:46.568789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 171/344] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:46 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28514 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:46.672067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fde4ecd4-e284-499b-87d9-aaa80ed09c4f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28441 microversion: 2.20 time: 0.135558 Nov 22 23:01:46.676671 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 174/345] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:46 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28441 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:46.768491 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:46.769184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:46.775957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:46.776407 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:46.777193 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:46.777647 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:46.930589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:46.938205 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cf5ef042-af8e-42c4-ba4c-5f500ba66bb9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.173698 Nov 22 23:01:46.938764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 172/346] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:46 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:47.578408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:47.579955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:47.588173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:47.588784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:47.589653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:47.590158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:47.684887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:47.685836 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:47.692975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:47.693424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:47.694361 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:47.694787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:47.699576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e38f0a92-6933-4b7e-beb5-32b77a0079be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.126150 Nov 22 23:01:47.700364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 175/347] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:47 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:47.794256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c2e5e43e-1ae8-45d9-96f2-befc3e3a28bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28441 microversion: 2.20 time: 0.112925 Nov 22 23:01:47.798445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 173/348] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:47 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28441 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:47.957846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:47.958952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:47.965941 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:47.966510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:47.967433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:47.967953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:48.199563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:48.211047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-122c8c5b-ec0d-430d-a6c8-714dc2256d72 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.258321 Nov 22 23:01:48.222989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 176/349] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:47 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:48.713046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:48.714297 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:48.722391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:48.722839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:48.723619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:48.724262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:48.806599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:48.807434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:48.821044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:48.822050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:48.823237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:48.823676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:48.845720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7a201e43-c185-4a61-98c2-a16afd1ddcde tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.137551 Nov 22 23:01:48.848194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 174/350] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:48 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:49.062041 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-431bb5af-7f7d-450b-8079-4e291eed6c53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.258830 Nov 22 23:01:49.062702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 177/351] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:48 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:49.230184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:49.230894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:49.241111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:49.241673 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:49.242478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:49.242907 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:49.388924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:49.399021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4d248046-2b68-4a0e-8bb9-1b5ee0c9d957 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.174453 Nov 22 23:01:49.400154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 175/352] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:49 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:49.859328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:49.860581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:49.869182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:49.869899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:49.870740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:49.871237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:49.957102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-31daab79-1858-45bb-b467-ab5da9a255d0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.101785 Nov 22 23:01:49.957960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 178/353] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:49 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:50.073898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:50.074851 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:50.091133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:50.091592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:50.092390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:50.092867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:50.202638 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3538fa78-89dd-4fcb-903f-514e4f4228a3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.132142 Nov 22 23:01:50.206866 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 176/354] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:50 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:50.421232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:50.422014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:50.430270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:50.430947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:50.431721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:50.432145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:50.585603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:50.593050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4f61aeba-96c7-4800-b44f-9bd09e9d9430 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.176407 Nov 22 23:01:50.593819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 179/355] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:50 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:50.969006 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:50.970119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:50.978586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:50.978952 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:50.979592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:50.980198 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:51.181914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-445fd867-124f-4c0a-9d84-d408902037f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.217098 Nov 22 23:01:51.186646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 177/356] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:50 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:51.216051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:51.217004 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:51.228378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:51.228899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:51.229665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:51.230269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:51.373116 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5a431849-975a-4125-a796-082caab46ec7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.162117 Nov 22 23:01:51.373954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 180/357] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:51 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:51.611146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:51.612622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:51.619531 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:51.619974 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:51.620948 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:51.621389 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:51.767190 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:51.777242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2c0a0169-a053-4a1d-8ecd-99c790926738 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.169928 Nov 22 23:01:51.778600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 178/358] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:51 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:52.195654 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:52.196764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:52.203826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.204380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.205277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.206145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.328782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6386813b-619d-4335-8670-a4aaf112f604 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.136740 Nov 22 23:01:52.333263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 181/359] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:52 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:52.394248 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:52.400787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:52.406238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.406616 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.407323 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.407757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.514193 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a92f8a39-cd7e-4a01-b6a4-bb7c3d5b9b96 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.123943 Nov 22 23:01:52.515790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 179/360] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:52 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:52.797231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:52.798664 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:52.805840 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.806279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.807237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.807667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.944788 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:52.956638 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-66915467-1d67-48b0-a4fe-e34d3e768e1d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1501 microversion: 2.1 time: 0.162246 Nov 22 23:01:52.957417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 182/361] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:52 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:52.974333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42398e15-36cd-4f78-9e1c-8a8a38c60c8a"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:52.975581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:52.982497 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.983025 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:52.983817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:52.984260 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.009189 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] HTTP exception thrown: Cannot 'attach_volume' instance 51cf0f00-ab35-48da-bd27-6fba3194dcff while it is in vm_state rescued Nov 22 23:01:53.009811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Returning 409 to user: Cannot 'attach_volume' instance 51cf0f00-ab35-48da-bd27-6fba3194dcff while it is in vm_state rescued {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:01:53.010658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4f484fc9-e907-4c22-a16e-411d68b6de05 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041167 Nov 22 23:01:53.011215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 180/362] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:01:52 2021] POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 22 23:01:53.020460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:53.020984 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:53.027269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.027725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.028549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.028986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.096864 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ba66b89f-641c-472e-b3a2-9c428a323ec2 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action" status: 202 len: 0 microversion: 2.1 time: 0.080570 Nov 22 23:01:53.097731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 183/363] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:53 2021] POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:53.105881 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:53.106549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:53.113304 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.113790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.114585 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.115050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.322370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:53.331251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-12f15e38-0246-4b37-b72b-94c6a4cf3d68 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1509 microversion: 2.1 time: 0.228646 Nov 22 23:01:53.332024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 181/364] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:53 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:01:53.347608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:53.350051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:53.360633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.361405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.362324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.362868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.502728 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-efd7b726-57d0-4c51-b1fa-f8f7f6145198 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.159006 Nov 22 23:01:53.503723 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 184/365] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:53 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:01:53.530230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:53.531817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:53.539521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.540080 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.540957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:53.542165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:53.646774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c2ce9a60-aa2e-41e7-bfc6-92e3a3e052c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.120897 Nov 22 23:01:53.652017 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 182/366] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:53 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:54.355824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:54.356600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:54.364276 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:54.364732 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:54.365524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:54.365996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:54.512782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:54.515251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:54.516324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:54.523044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f11db96b-524a-43d5-b7a5-24a19588c110 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1509 microversion: 2.1 time: 0.178237 Nov 22 23:01:54.523710 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 185/367] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:54 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:54.524479 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:54.525309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:54.525772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:54.526210 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:54.659608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:54.660505 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:54.668346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:54.668802 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:54.669889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:54.670327 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:54.785149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-facdd07c-2deb-4f17-943d-92cf45a5b07b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.273748 Nov 22 23:01:54.786652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 183/368] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:54 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:01:54.801992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4da932a8-3e2b-4970-8f27-91b66f91ee4b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.145988 Nov 22 23:01:54.802816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 186/369] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:54 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:55.541108 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:55.541823 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:55.548655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:55.549135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:55.549938 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:55.550370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:55.680965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:55.688874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-beac3215-d2ec-4e2c-bdd8-02688da7d1af tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1509 microversion: 2.1 time: 0.152298 Nov 22 23:01:55.689454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 184/370] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:55 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:55.797276 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:55.798297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:55.805776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:55.806228 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:55.806997 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:55.807432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:55.814068 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:55.815937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:55.822246 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:55.822697 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:55.823482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:55.823927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:55.967989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32414b9b-ff74-4fb1-931b-cefc110baf14 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.174713 Nov 22 23:01:55.968869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 187/371] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:55 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:55.982988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2e5f7009-d23e-4853-a9fb-dd547c818fc4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.172508 Nov 22 23:01:55.983618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 185/372] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:55 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:01:56.500388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-457829244", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "cf5659d0-a132-4ec4-a980-7145a1826e0a"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:56.604285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-194435696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-998649441", "security_groups": [{"name": "tempest-secgroup-smoke-438128512"}], "networks": [{"uuid": "b486bead-762c-46e4-ac1b-a687c9397500"}], "block_device_mapping_v2": [{"uuid": "8719c674-1525-4575-8127-944f0d7bab53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:56.688068 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] validate_networks() for [('cf5659d0-a132-4ec4-a980-7145a1826e0a', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:01:56.973770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] validate_networks() for [('b486bead-762c-46e4-ac1b-a687c9397500', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:01:57.496565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:01:57.497577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:01:57.498492 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:01:57.499010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:01:57.499532 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:01:57.510898 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.511645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.512977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.513659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.535731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Getting quotas for project 1734d6e5ada24e74857dbeaf2a19d2ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:01:57.540949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Getting quotas for user e4f494ba6b194db1915c334280aa724d and project 1734d6e5ada24e74857dbeaf2a19d2ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:01:57.553836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:01:57.556508 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:01:57.604056 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:01:57.604989 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:01:57.605540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:01:57.606151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:01:57.606887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:01:57.609067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-50fd6922-90bd-49d0-a7ef-ba00ca8d02a7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112014 Nov 22 23:01:57.610131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 188/373] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:01:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:01:57.621290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.621776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.622454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:57.622902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.623511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.623849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:57.634097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.634550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.635358 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.635952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.673988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Getting quotas for project f8e29191d83b4af2b4c82ff4194343c7. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:01:57.682993 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Getting quotas for user 93034034fa934b7486a203f4783835ad and project f8e29191d83b4af2b4c82ff4194343c7. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:01:57.786722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:01:57.790333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8719c674-1525-4575-8127-944f0d7bab53',volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:01:57.868199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:57.879390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f214fe17-9112-4d2d-ad48-9fe11b74c6cc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1509 microversion: 2.1 time: 0.268009 Nov 22 23:01:57.880325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 189/374] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:57 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:57.886357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:57.887390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:57.896092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.896828 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.897317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:57.897838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:57.975821 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [c9e46c45-30db-45c7-bfee-460f0384521f] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 23:01:58.006142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c03c344e-3ea6-4a30-a9a4-b20bd479f65a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.124179 Nov 22 23:01:58.006897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 190/375] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:57 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:58.012206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:58.013195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:58.021929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:58.022399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:58.023215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:58.023644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:58.135348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3111821e-3872-44f5-bf4a-e2d18b351cd8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.127017 Nov 22 23:01:58.136046 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 191/376] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:58 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:01:58.141318 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2108077191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-283226992", "security_groups": [{"name": "tempest-secgroup-smoke-523553842"}], "block_device_mapping_v2": [{"uuid": "a1e98506-8899-4f65-bf19-c88e6c08bb2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b01dbc7-4a1a-48b9-85b0-7d9ce9e6dcb9"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:58.276703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] validate_networks() for [('0b01dbc7-4a1a-48b9-85b0-7d9ce9e6dcb9', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:01:58.678954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:01:58.680304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:01:58.681271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:01:58.681729 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:01:58.682317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:01:58.691765 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:58.692458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:58.693311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:58.693822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:58.711919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for project 4371c64c75764f9c80faa90370720ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:01:58.716144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for user 4fe1833c77424a2d9ba3d33f1793c9f4 and project 4371c64c75764f9c80faa90370720ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:01:58.781115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:01:58.784327 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1e98506-8899-4f65-bf19-c88e6c08bb2f',volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:01:58.948502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a72220b5-9ad2-4275-9dea-75c53e0fcd23 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811071 Nov 22 23:01:58.954087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 192/377] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:01:58 2021] POST /compute/v2.1/servers => generated 405 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:01:58.964440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:58.965367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:58.972745 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:58.973158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:58.974195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:58.974641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:58.997679 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [c9e46c45-30db-45c7-bfee-460f0384521f] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 35822. Nov 22 23:01:59.005585 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-40fe4d8a-0709-4f93-bd2e-361ac37dff23 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.405529 Nov 22 23:01:59.006941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 186/378] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:01:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 23:01:59.011069 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:59.014804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:59.076907 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:59.085478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f750d425-846a-4329-9084-f9a7c8369924 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1271 microversion: 2.1 time: 0.129209 Nov 22 23:01:59.096367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 193/379] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:58 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:59.101687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4d3e7952-2d80-479f-97d3-d55efcaa4b8c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:59.102930 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4d3e7952-2d80-479f-97d3-d55efcaa4b8c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:59.170637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4d3e7952-2d80-479f-97d3-d55efcaa4b8c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:59.177949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4d3e7952-2d80-479f-97d3-d55efcaa4b8c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1094 microversion: 2.1 time: 0.079988 Nov 22 23:01:59.179180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 194/380] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:59 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:59.183959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fe13b213-fb44-4584-8fe4-faff4cdb260b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:01:59.184948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fe13b213-fb44-4584-8fe4-faff4cdb260b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:59.216434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:59.216991 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:59.217892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:59.218403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:59.258830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fe13b213-fb44-4584-8fe4-faff4cdb260b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:59.266375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fe13b213-fb44-4584-8fe4-faff4cdb260b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1087 microversion: 2.1 time: 0.086029 Nov 22 23:01:59.267066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 195/381] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:59 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:59.272475 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:59.273544 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:59.279929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:59.280497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:59.281402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:59.282037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:59.374123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-916d7f8a-8035-4db9-96a0-b6e62974e246 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.104292 Nov 22 23:01:59.374663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 196/382] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:01:59 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:01:59.380814 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:01:59.382084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:01:59.389559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:59.390045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:59.390942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:01:59.391520 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:01:59.401501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:01:59.409990 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-49a30c54-4e71-4c85-b343-c347ed976b3d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1515 microversion: 2.1 time: 0.402228 Nov 22 23:01:59.410998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 187/383] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:01:59 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1515 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:01:59.505505 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-688374a3-49df-4b87-9db9-3668348d9fde tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.129298 Nov 22 23:01:59.507052 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 197/384] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:01:59 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:00.102522 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:00.103468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:00.110063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.110632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.112196 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.112860 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.201800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7fd42495-5279-4d6e-985b-e93f80a4e076 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:00.202502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7fd42495-5279-4d6e-985b-e93f80a4e076 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:00.285468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7fd42495-5279-4d6e-985b-e93f80a4e076 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:00.293805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7fd42495-5279-4d6e-985b-e93f80a4e076 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1094 microversion: 2.1 time: 0.101215 Nov 22 23:02:00.300241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 198/385] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:00 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:00.305038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b708f7c6-ffe0-40aa-8fe5-f00d1a5a3c6a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:00.306696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b708f7c6-ffe0-40aa-8fe5-f00d1a5a3c6a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:00.350215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:00.359183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d9d9f2f5-af32-42de-a604-99e928531483 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.260209 Nov 22 23:02:00.360712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 188/386] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:00 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:00.388450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:00.389546 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:00.392989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b708f7c6-ffe0-40aa-8fe5-f00d1a5a3c6a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:00.398839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.399701 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.400908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.401034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b708f7c6-ffe0-40aa-8fe5-f00d1a5a3c6a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1087 microversion: 2.1 time: 0.099243 Nov 22 23:02:00.401519 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 199/387] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:00 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1087 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:00.401942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.513121 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8369faab-ea72-4685-901a-14980a497699 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.131653 Nov 22 23:02:00.514511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 189/388] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:00 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:00.518986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:00.520005 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:00.527190 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.528337 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.529341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.529936 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.596836 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-f521e432-2e6a-4c6f-907c-6995d0ee5a98 req-8a8b9537-f3c6-4109-b826-55d31358002d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12da941f-db01-4c12-b5dd-8b1a3051048f", "tag": "759d7d9f-096c-4010-a81e-a5c2414aa57c"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:00.603714 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:00.603714 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:02:00.612919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f521e432-2e6a-4c6f-907c-6995d0ee5a98 req-8a8b9537-f3c6-4109-b826-55d31358002d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.613918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f521e432-2e6a-4c6f-907c-6995d0ee5a98 req-8a8b9537-f3c6-4109-b826-55d31358002d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.624718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-f521e432-2e6a-4c6f-907c-6995d0ee5a98 req-8a8b9537-f3c6-4109-b826-55d31358002d service nova] Creating event network-changed:759d7d9f-096c-4010-a81e-a5c2414aa57c for instance 12da941f-db01-4c12-b5dd-8b1a3051048f on hv-cinder-81883 Nov 22 23:02:00.631228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-f521e432-2e6a-4c6f-907c-6995d0ee5a98 req-8a8b9537-f3c6-4109-b826-55d31358002d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038293 Nov 22 23:02:00.632688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 190/389] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:02:00.633608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1e15895e-6a0d-48b8-a800-f7b638175e29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.118630 Nov 22 23:02:00.638399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 200/390] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:00 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:00.776569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:00.777536 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:00.784284 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.784937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:00.785897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:00.786480 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.013049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:01.020332 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8e5ecc67-c77d-4a0c-b3bb-499dd2ffb701 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1515 microversion: 2.1 time: 0.248221 Nov 22 23:02:01.020894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 191/391] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:00 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:01.038043 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3c12616-b5f8-4da9-b776-4c7033d5ecbc"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:01.039758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:01.047089 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.047645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.049333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.050056 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.317178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:01.317856 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:01.325828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.326473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.327595 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.328192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.381384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-344641a5-4b84-4bb1-9a74-cc3455e6c5cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337542 Nov 22 23:02:01.383237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 201/392] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:02:01 2021] POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:01.389656 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:01.390807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:01.398481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.399181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.400197 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.400817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.421904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:01.430083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-254c0be3-b811-4aab-bd9e-212652d270d9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1144 microversion: 2.1 time: 0.117322 Nov 22 23:02:01.430655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 192/393] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:01 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1144 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:01.440722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-02dd0e19-d2e2-4a19-9e83-be4d8a259baf tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:01.440722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-02dd0e19-d2e2-4a19-9e83-be4d8a259baf tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:01.526624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-02dd0e19-d2e2-4a19-9e83-be4d8a259baf tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:01.536448 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-02dd0e19-d2e2-4a19-9e83-be4d8a259baf tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1087 microversion: 2.1 time: 0.104646 Nov 22 23:02:01.537420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 193/394] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:01 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1087 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:01.554731 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:01.556289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:01.565005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.565553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.566619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.567265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.646262 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:01.661598 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9456b742-2202-4a8a-8237-9bff2363e361 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.276884 Nov 22 23:02:01.671970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 202/395] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:01 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:01.672202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4afa4d52-db8b-4cff-92db-e328952b3c34 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.121153 Nov 22 23:02:01.672202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 194/396] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:01 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:01.675960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:01.677152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:01.683249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.683695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.684481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:01.684911 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:01.828236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f4715bcf-a9cb-4eed-b1da-4a3afa3e9a63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.164748 Nov 22 23:02:01.828900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 203/397] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:01 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:02.447897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:02.448877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:02.458237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.458960 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.460505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.460947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.558659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:02.565266 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:02.566977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:02.578652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-76b18def-6813-4ea4-b3b3-89f1cea0b3fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1210 microversion: 2.1 time: 0.132922 Nov 22 23:02:02.579251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 195/398] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:02 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1210 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:02.582949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.583398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.584228 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.584663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.678985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:02.680001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:02.687708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.688455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.689128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:02.689928 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.690684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.698361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-233f9eef-fc62-49e8-948a-9b24170d81f9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1185 microversion: 2.1 time: 0.146247 Nov 22 23:02:02.709708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 204/399] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:02 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:02.716270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:02.717915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:02.725498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.726646 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.727451 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.727893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.859842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8a4e6698-3d59-4d10-845b-c86b785cce44 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.148768 Nov 22 23:02:02.860616 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 205/400] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:02 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:02.865849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:02.866942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:02.874655 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.875227 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.876117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:02.876625 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:02.881375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:02.898693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e1a06163-73c2-4fca-b312-03a851cef9f4 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.223209 Nov 22 23:02:02.900285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 196/401] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:02 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:03.032459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2ac42856-a733-442c-959c-c25995a31299 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.170386 Nov 22 23:02:03.033841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 206/402] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:02 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:03.597393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:03.598089 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:03.617024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.617264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.618089 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.618527 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.716256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:03.717082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:03.725346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.725970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.726858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.727381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.812079 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:03.824338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-83092269-6030-49b4-ae20-daf3486286de tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1203 microversion: 2.1 time: 0.111741 Nov 22 23:02:03.825181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 207/403] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:03 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1203 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:03.874903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:03.875815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:03.884359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.884899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.885601 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.886066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.910515 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:03.920396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-00e05a45-15a4-42b4-91bc-da00b32053fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1277 microversion: 2.1 time: 0.327669 Nov 22 23:02:03.921829 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 197/404] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:03 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:03.926818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:03.928814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:03.936110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.936548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:03.937331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:03.937827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.035511 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-45f8b2d5-0fe2-4eac-9538-edd662a06715 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.164109 Nov 22 23:02:04.046119 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 208/405] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:03 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:04.052715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:04.054686 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:04.061946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.062397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.063522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.064118 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.158195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-976ed18e-f91c-4da7-bda7-20cd5106455a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.110198 Nov 22 23:02:04.162596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 209/406] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:04 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:04.170934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:04.179511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9481a538-360c-42e2-b509-4fb3a28baf8b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.256560 Nov 22 23:02:04.188962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 198/407] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:03 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:04.351071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-ebbb68e5-b8c3-432a-9908-7dc6fd4ded28 req-c5441a63-fe68-4f95-9093-bcbe4f8dae63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee39353a-7b66-48b7-b735-20f76c7b3545", "tag": "dacb0548-77df-4148-a7b2-738040851ec4"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:04.353305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:04.353305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:04.374729 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-ebbb68e5-b8c3-432a-9908-7dc6fd4ded28 req-c5441a63-fe68-4f95-9093-bcbe4f8dae63 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.375198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-ebbb68e5-b8c3-432a-9908-7dc6fd4ded28 req-c5441a63-fe68-4f95-9093-bcbe4f8dae63 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.411258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-ebbb68e5-b8c3-432a-9908-7dc6fd4ded28 req-c5441a63-fe68-4f95-9093-bcbe4f8dae63 service nova] Creating event network-changed:dacb0548-77df-4148-a7b2-738040851ec4 for instance ee39353a-7b66-48b7-b735-20f76c7b3545 on hv-cinder-81883 Nov 22 23:02:04.422300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-ebbb68e5-b8c3-432a-9908-7dc6fd4ded28 req-c5441a63-fe68-4f95-9093-bcbe4f8dae63 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077996 Nov 22 23:02:04.427590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 210/408] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:04.842945 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:04.844121 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:04.853126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.853750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.854627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.855328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.939324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:04.942584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:04.956143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.957159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:04.958028 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:04.958696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.104691 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:05.114687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8a3cfb4b-7566-4477-9cbf-adb3f5c8ebf5 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1270 microversion: 2.1 time: 0.275996 Nov 22 23:02:05.125403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 199/409] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:04 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:05.132606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:05.133820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:05.140851 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.141592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.142642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.143254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.239775 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0a9a7ba7-ca8a-4308-8b64-701ac5e19db5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.111537 Nov 22 23:02:05.240656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 200/410] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:05 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:05.246909 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:05.248039 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:05.260206 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.261184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.262588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.263146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.292310 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:05.305966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-91127389-0136-4da3-aea4-7f8fbed66480 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1277 microversion: 2.1 time: 0.370615 Nov 22 23:02:05.316014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 211/411] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:04 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1277 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:05.322550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-28f0ecfc-4b9c-44e0-a046-c3452a8061f4 req-003ae2e3-098a-40cb-9073-1a61f1df6ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:05.324707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:05.324707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:05.332351 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-28f0ecfc-4b9c-44e0-a046-c3452a8061f4 req-003ae2e3-098a-40cb-9073-1a61f1df6ef6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.332788 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-28f0ecfc-4b9c-44e0-a046-c3452a8061f4 req-003ae2e3-098a-40cb-9073-1a61f1df6ef6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.347888 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-28f0ecfc-4b9c-44e0-a046-c3452a8061f4 req-003ae2e3-098a-40cb-9073-1a61f1df6ef6 service nova] Creating event network-changed:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:02:05.352782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-28f0ecfc-4b9c-44e0-a046-c3452a8061f4 req-003ae2e3-098a-40cb-9073-1a61f1df6ef6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035155 Nov 22 23:02:05.353382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 212/412] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:05.359111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:05.359866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:05.367691 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.368139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.368934 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:05.369381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:05.394949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-348d2889-2287-4f5b-bf13-15e7879736e2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.152804 Nov 22 23:02:05.396771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 201/413] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:05 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:05.559495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:05.569050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e2f9e4b5-f9a2-4421-ad10-7313e4cfafce tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.214299 Nov 22 23:02:05.570286 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 213/414] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:05 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:06.132728 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:06.133423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:06.140393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.140844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.141656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.142088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.252402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:06.253549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:06.259956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.260450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.261195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.261661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.293689 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:06.301057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d52bb4a6-d77e-4aed-9cd3-b0f2858d2c93 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1270 microversion: 2.1 time: 0.172483 Nov 22 23:02:06.301643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 202/415] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:06 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:06.323379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:06.324261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:06.332306 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.332793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.333645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.334093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.376473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fd1089b7-4fb3-4cb1-b133-f0050e8e5563 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.127850 Nov 22 23:02:06.378473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 214/416] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:06 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:06.410085 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:06.411167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:06.425241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.425453 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.426163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.426604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.474897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:06.482146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-abc1f839-46b9-4309-80f0-93eefdf0747c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1277 microversion: 2.1 time: 0.162761 Nov 22 23:02:06.482713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 203/417] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:06 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:06.537099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7af31d4d-66ce-4196-b4cb-fc05fc9ca300 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.132843 Nov 22 23:02:06.538018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 215/418] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:06 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:06.586356 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:06.586961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:06.592644 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.593088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.593883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:06.594312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:06.722866 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:06.730347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a7e7376d-6ee9-42c1-b291-d7b793612fd9 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.147472 Nov 22 23:02:06.730927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 204/419] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:06 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:07.319109 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:07.319801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:07.326684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.327134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.327909 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.328341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.388819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:07.389828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:07.397185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.397666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.398467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.398900 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.465054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:07.472457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c29615d0-bce0-4991-bedf-e7e294d1f49c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1270 microversion: 2.1 time: 0.158038 Nov 22 23:02:07.473019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 216/420] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:07 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:07.488463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ff3e20e1-d7ef-4ccb-8c6b-b0b11d0b3256 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.103133 Nov 22 23:02:07.489112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 205/421] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:07 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:07.498774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:07.499389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:07.506232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.506680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.507466 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.507900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.548992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:07.550020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:07.556848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.557289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.558272 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.558697 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.645217 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:07.647106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b9f958ce-feab-4bce-9246-67d9af04891c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.102208 Nov 22 23:02:07.648668 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 206/422] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:07 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:07.655488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d94d7f31-b7e1-462b-a4bd-a234859bf9f7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1277 microversion: 2.1 time: 0.159029 Nov 22 23:02:07.655488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 217/423] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:07 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:07.748130 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:07.748867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:07.756390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.756842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.757645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:07.758083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:07.890937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:07.899188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9c6d44f9-cad2-49d8-ac5e-3bfa9bd759cd tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.154991 Nov 22 23:02:07.899747 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 207/424] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:07 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:08.349967 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-104d932a-89bd-4465-83ac-2092093c154a req-99fa6be3-8d39-4c40-9463-58e72a533d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12da941f-db01-4c12-b5dd-8b1a3051048f", "name": "network-vif-plugged", "status": "completed", "tag": "759d7d9f-096c-4010-a81e-a5c2414aa57c"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:08.353361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:08.353361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:08.364634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-104d932a-89bd-4465-83ac-2092093c154a req-99fa6be3-8d39-4c40-9463-58e72a533d99 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.365408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-104d932a-89bd-4465-83ac-2092093c154a req-99fa6be3-8d39-4c40-9463-58e72a533d99 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.379957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-104d932a-89bd-4465-83ac-2092093c154a req-99fa6be3-8d39-4c40-9463-58e72a533d99 service nova] Creating event network-vif-plugged:759d7d9f-096c-4010-a81e-a5c2414aa57c for instance 12da941f-db01-4c12-b5dd-8b1a3051048f on hv-cinder-81883 Nov 22 23:02:08.396921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-104d932a-89bd-4465-83ac-2092093c154a req-99fa6be3-8d39-4c40-9463-58e72a533d99 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053245 Nov 22 23:02:08.398134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 218/425] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:02:08.488159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:08.488773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:08.495392 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.495844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.496807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.497391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.501578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:08.503233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:08.510000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.510586 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.511478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.512482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.611398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f569f60d-68a2-4478-a97b-0ae73ff806c5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.113848 Nov 22 23:02:08.612061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 219/426] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:08 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:08.645218 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:08.653027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0872715a-ea2d-487a-b9bd-b1fb3c20988b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1270 microversion: 2.1 time: 0.168693 Nov 22 23:02:08.653596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 208/427] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:08 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:08.660420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:08.661426 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:08.669299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.669926 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.670703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.671130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.671838 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:08.672392 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:08.678902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.679379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.680225 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.680666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.823182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:08.831412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b83a185a-a17c-45ff-bee0-5357d000b4cb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1277 microversion: 2.1 time: 0.163174 Nov 22 23:02:08.831985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 209/428] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:08 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:08.916038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:08.916710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:08.922590 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.922987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:08.923779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:08.924384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.063687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:09.071684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bb74f52f-49df-41e8-8e81-939592f835bc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.159585 Nov 22 23:02:09.072242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 210/429] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:08 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:09.077299 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:09.078720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:09.085534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.086016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.086797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.087232 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.110165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lazy-loading 'flavor' on Instance uuid 51cf0f00-ab35-48da-bd27-6fba3194dcff {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:02:09.204193 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9bb4979e-fc2b-48a2-a704-aea0576e37da tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.548478 Nov 22 23:02:09.205137 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 220/430] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:08 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:09.235712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-54e411d9-3c24-4b78-b864-857750552d64 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action" status: 200 len: 32 microversion: 2.1 time: 0.162112 Nov 22 23:02:09.237080 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 211/431] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:09 2021] POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:02:09.246552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:09.247249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:09.254301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.254721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.255514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.256014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.398461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:09.407049 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e335a47a-6959-4f44-88bc-7a0a0b7eba04 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.164310 Nov 22 23:02:09.407663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 221/432] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:09 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:09.625792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:09.627852 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:09.633579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.634078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.634853 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.635580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.670325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:09.670849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:09.677265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.677790 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.678521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.678948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.811288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:09.819371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1b3f8c93-5c87-46aa-ab52-79dd3ea50e2b tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1270 microversion: 2.1 time: 0.152621 Nov 22 23:02:09.820063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 222/433] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:09 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:09.848989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:09.849660 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:09.856708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.857230 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.858153 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:09.858647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:09.882651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-27ce896d-2f15-45a4-8b79-8af564b2e89f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.261384 Nov 22 23:02:09.883371 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 212/434] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:09 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:10.001283 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:10.009400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-366f78e7-d4cd-4992-9056-342361576502 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.164809 Nov 22 23:02:10.010086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 223/435] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:09 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:10.090523 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:10.091252 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:10.098914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.099369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.100163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.100594 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.216406 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:10.217308 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:10.223888 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.224374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.225162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.225602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.235921 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:10.243349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-948f040b-2df8-4641-859a-43a6b634d9b2 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1313 microversion: 2.1 time: 0.156857 Nov 22 23:02:10.243998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 213/436] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:10 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:10.425936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:10.426581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:10.432868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.433322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.434128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.434576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.567382 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:10.575174 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-60615c9e-371f-4df3-8819-f8e202c245a6 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.153482 Nov 22 23:02:10.575739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 214/437] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:10 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:10.694273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7cd01039-8fef-4ee7-94c2-decde9b873f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.481450 Nov 22 23:02:10.695009 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 224/438] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:10 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:10.836417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:10.837024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:10.843436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.844112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.844891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.845331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.895556 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:10.896568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:10.903462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.903916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.904701 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:10.905136 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:10.978292 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:10.985567 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-089a86f9-373a-4fea-8f5e-6fda7a3f130e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.152833 Nov 22 23:02:10.987296 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 215/439] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:10 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:11.025859 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dd970d9f-22cf-4f24-9b3c-930d26c8db80 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.134417 Nov 22 23:02:11.026717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 225/440] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:10 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:11.027562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:11.028173 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:11.034735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.035175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.035946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.036377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.170048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:11.179027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-deef8c35-c803-43fe-ae83-4c9bcd545883 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.155058 Nov 22 23:02:11.179598 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 216/441] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:11 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:11.260459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:11.261151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:11.268157 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.268596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.269368 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.269854 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.409856 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:11.417338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8742ab5a-a10c-454a-a927-2bc483db97ca tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1498 microversion: 2.1 time: 0.160849 Nov 22 23:02:11.417933 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 226/442] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:11 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:11.592823 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:11.593428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:11.600547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.600989 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.601789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.602219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.707333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:11.708697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:11.715339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.715805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.716582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.717016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.738229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:11.746227 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b14683df-f81e-474e-93e1-56db6b2f53a3 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.157359 Nov 22 23:02:11.746795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 217/443] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:11 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:11.804659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e4516263-57cf-4e3c-b2fa-1b7cfb6eb209 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.101527 Nov 22 23:02:11.805531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 227/444] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:11 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:11.925659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:11.926159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:11.931868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.932319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.933104 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:11.933548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:11.958503 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:02:12.004936 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:12.005636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:12.012698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.013148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.013963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.014402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.034161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a0d8c1a0-b03a-41c5-8121-4875b40d5c65 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "DELETE /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 204 len: 0 microversion: 2.1 time: 0.111984 Nov 22 23:02:12.034895 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 218/445] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:02:11 2021] DELETE /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:02:12.041988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:12.043063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:12.048967 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.049422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.050368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.050809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.158828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1e2d7871-b7d6-4dca-ac99-359366531163 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.121727 Nov 22 23:02:12.159492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 219/446] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:12 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:12.159945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:12.164611 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:12.165305 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:12.167746 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fa17a289-f14d-4933-8b98-e6d6ac132a97 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.167238 Nov 22 23:02:12.168315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 228/447] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:11 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:12.172260 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.172716 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.174038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.174477 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.195846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:12.196465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:12.202381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.202905 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.203753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.204274 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.370335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:12.378526 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d17888ad-2df8-4d39-981d-2a491498ef34 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1504 microversion: 2.1 time: 0.217893 Nov 22 23:02:12.379164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 220/448] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:12 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:12.384199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:12.391885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-016af4d6-82ea-4c27-8c43-e2f79c304566 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.199784 Nov 22 23:02:12.392701 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 229/449] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:12 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:12.763111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:12.763726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:12.770195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.770646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.771585 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.772020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.816373 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:12.817393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:12.824078 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.824613 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.825489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:12.826036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:12.907139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:12.915951 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cf0bf23b-2e66-40f9-8f57-90c25ba3619e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.156473 Nov 22 23:02:12.916521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 221/450] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:12 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:12.957092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-474d3167-6ae8-4e15-9955-75e02dadb7fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.144645 Nov 22 23:02:12.957805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 230/451] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:12 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:13.170643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:13.171622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:13.178039 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.178729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.179548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.179999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.185478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:13.186232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:13.193420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.193962 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.194782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.195224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.275583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-161abcbd-b9d7-4327-80ca-0a1ffd8042a3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.108375 Nov 22 23:02:13.276228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 222/452] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:13 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:13.331867 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:13.339369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b8f68dba-3119-45c8-8e5c-e74560e77c67 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.157905 Nov 22 23:02:13.339932 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 231/453] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:13 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:13.397214 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:13.397933 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:13.404729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.405169 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.405965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.406391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.407828 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:13.408767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:13.414901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.415354 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.416140 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.416582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.606783 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:13.610794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:13.614368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-06b06ab4-a9bf-4c52-830b-644ad1d15cc7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1504 microversion: 2.1 time: 0.221708 Nov 22 23:02:13.614932 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 223/454] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:13 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:13.618045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f2bdbe27-0fda-4ca3-8a2d-8a3db2827abc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.213804 Nov 22 23:02:13.618605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 232/455] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:13 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:13.932010 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:13.932643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:13.939749 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.940175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.940962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.941400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.968470 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:13.969467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:13.976488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.976963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:13.977835 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:13.978279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.074154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:14.081874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bb56be27-0eda-4d45-a9bd-a84f82e93168 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.153428 Nov 22 23:02:14.082432 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 224/456] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:13 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:14.117177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f86efadc-703d-4769-b1f2-4a6df06bf149 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.152334 Nov 22 23:02:14.117978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 233/457] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:13 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:14.287712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:14.288626 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:14.295241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.295689 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.296458 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.296886 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.356595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:14.357296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:14.364880 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.365342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.366161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.366598 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.405635 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f72c5249-d129-480a-b5e6-91f4a945f9d6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.121258 Nov 22 23:02:14.409515 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 225/458] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:14 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:14.511021 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:14.518637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d3463782-9590-4ca1-852d-ee3c46fcac27 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.166081 Nov 22 23:02:14.519207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 234/459] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:14 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:14.565010 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-6e1ec41f-0148-4aed-b4d1-515f601470b7 req-93daf259-e7ea-4a92-ab81-49f7d07b8061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12da941f-db01-4c12-b5dd-8b1a3051048f", "name": "network-vif-deleted", "tag": "759d7d9f-096c-4010-a81e-a5c2414aa57c"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:14.567017 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:14.567017 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:02:14.575678 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-6e1ec41f-0148-4aed-b4d1-515f601470b7 req-93daf259-e7ea-4a92-ab81-49f7d07b8061 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.576127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-6e1ec41f-0148-4aed-b4d1-515f601470b7 req-93daf259-e7ea-4a92-ab81-49f7d07b8061 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.588407 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-6e1ec41f-0148-4aed-b4d1-515f601470b7 req-93daf259-e7ea-4a92-ab81-49f7d07b8061 service nova] Creating event network-vif-deleted:759d7d9f-096c-4010-a81e-a5c2414aa57c for instance 12da941f-db01-4c12-b5dd-8b1a3051048f on hv-cinder-81883 Nov 22 23:02:14.593078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-6e1ec41f-0148-4aed-b4d1-515f601470b7 req-93daf259-e7ea-4a92-ab81-49f7d07b8061 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033093 Nov 22 23:02:14.593878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 226/460] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:14.631617 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:14.632216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:14.636254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:14.637111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:14.638764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.639210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.639986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.640407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.644727 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.645273 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.646162 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:14.646671 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:14.711166 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:14.718536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2982b771-3715-41d0-99e2-ffa6cc47caa8 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 200 len: 1298 microversion: 2.1 time: 0.090632 Nov 22 23:02:14.719102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 235/461] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:14 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:14.797931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:14.806396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7beeea0d-38c3-48f7-b30b-0daebb6a4043 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.174371 Nov 22 23:02:14.807009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 227/462] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:14 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:15.099512 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:15.100134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:15.106528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.106978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.107755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.108191 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.128848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:15.129854 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:15.136118 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.136573 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.137357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.137830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.234317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1f268343-9951-45db-a375-8f795d72f848 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.109410 Nov 22 23:02:15.238327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 228/463] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:15 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:15.244213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:15.252008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cf7db7b4-1bf0-4c69-976c-c6265c9d0139 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.157029 Nov 22 23:02:15.252570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 236/464] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:15 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:15.418554 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:15.419478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:15.426525 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.426980 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.427763 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.428208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.536125 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:15.536731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:15.538341 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-de02f668-987c-4b70-a318-5d3848cf2b59 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.123980 Nov 22 23:02:15.539254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 229/465] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:15 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:15.544908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.545349 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.546166 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.546593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.680279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:15.687858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0b8d10b8-d145-44ab-94c7-742868dca7ce tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.156350 Nov 22 23:02:15.688423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 237/466] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:15 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:15.735598 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:15.736874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: 12da941f-db01-4c12-b5dd-8b1a3051048f] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:15.743654 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.744096 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.744873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.745298 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.758577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] HTTP exception thrown: Instance 12da941f-db01-4c12-b5dd-8b1a3051048f could not be found. Nov 22 23:02:15.759155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Returning 404 to user: Instance 12da941f-db01-4c12-b5dd-8b1a3051048f could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:02:15.759958 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9d12eddd-c82f-4205-9208-64f47d5a8ada tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f" status: 404 len: 111 microversion: 2.1 time: 0.028353 Nov 22 23:02:15.760482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 230/467] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:15 2021] GET /compute/v2.1/servers/12da941f-db01-4c12-b5dd-8b1a3051048f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:02:15.822922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:15.823544 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:15.829359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.830052 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.830943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:15.831381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:15.854519 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1699194854", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "cf5659d0-a132-4ec4-a980-7145a1826e0a"}]}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:15.908713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] validate_networks() for [('cf5659d0-a132-4ec4-a980-7145a1826e0a', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:02:16.027404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:16.035356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f233c7ac-2d9b-4864-9381-3046b27a2644 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.216171 Nov 22 23:02:16.035914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 238/468] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:15 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:16.250590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:16.253368 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:16.261428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.262122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.263481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.264202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.294106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:02:16.294579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:02:16.295068 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:02:16.295484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:02:16.295887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:02:16.304712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.305149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.306097 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.306532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.323894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Getting quotas for project 1734d6e5ada24e74857dbeaf2a19d2ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:02:16.327829 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Getting quotas for user e4f494ba6b194db1915c334280aa724d and project 1734d6e5ada24e74857dbeaf2a19d2ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:02:16.339081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:02:16.341384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:02:16.385556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-db8cae70-815a-4fcd-9003-f6acaaa9c1d6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534634 Nov 22 23:02:16.386322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 231/469] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:02:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 23:02:16.390590 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:16.391307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:16.397943 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.398399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.399182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.399627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.507639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f5c4e5d4-b489-4774-b0f0-47a63f09d753 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.264526 Nov 22 23:02:16.509400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 239/470] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:16 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:16.514947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2e19e4cc-5e5f-44fc-ba03-c9f20aaba813 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:16.515704 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2e19e4cc-5e5f-44fc-ba03-c9f20aaba813 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:16.544311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:16.552444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-32c824b4-536d-421f-abfb-67e19da9b887 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.165065 Nov 22 23:02:16.553313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 232/471] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:16 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:16.557755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:16.559383 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:16.566580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.567023 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.567979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.568475 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.573546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2e19e4cc-5e5f-44fc-ba03-c9f20aaba813 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:16.580407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2e19e4cc-5e5f-44fc-ba03-c9f20aaba813 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1214 microversion: 2.1 time: 0.069768 Nov 22 23:02:16.580973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 240/472] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:16 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:16.668035 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b9ca7186-34b6-45c0-8a93-feea2202d9c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.113358 Nov 22 23:02:16.672293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 233/473] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:16 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:16.705557 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:16.706271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:16.713447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.713931 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.714721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:16.715157 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:16.856490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:16.864261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-350a808f-1ab7-48a3-962c-71790e6d774f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.162838 Nov 22 23:02:16.864834 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 241/474] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:16 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:17.054014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:17.054655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:17.061574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.062046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.062824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.063262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.197167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:17.205758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6009ba10-8094-4c0f-918b-4a051f64413c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.157147 Nov 22 23:02:17.206319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 234/475] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:17 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:17.275664 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:02:17.275874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:02:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:02:17.520233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:17.521211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:17.534717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.535171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.536010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.536468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.571911 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:17.572600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:17.580615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.580615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.581406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.581883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.644549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a0eadb97-2ff9-42c0-a348-136ef76823c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.128420 Nov 22 23:02:17.647006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 242/476] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:17 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:17.652653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:17.653647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:17.663967 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.664521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.665399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.665947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.751151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:17.758727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-91ee54df-4e59-436a-a428-9f506b450c5a tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1272 microversion: 2.1 time: 0.110210 Nov 22 23:02:17.759286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:17.769899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 243/477] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:17 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:17.769899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:17.769899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:17.771472 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.771861 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.772649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.773080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.778844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-dec6cdd6-c0c1-49b6-aee7-e05a95ac5d8e tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.211053 Nov 22 23:02:17.779449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 235/478] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:17 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:17.880601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:17.881213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:17.887819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.888272 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.889058 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:17.889498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:17.901692 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2bea88cf-e6c6-46e6-a5d3-aa9df5d02a2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.141144 Nov 22 23:02:17.902492 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 244/479] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:17 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:18.024799 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:18.032204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-28ccd4d7-3ef2-4c95-82b4-8da0bedb5095 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.155796 Nov 22 23:02:18.032871 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 236/480] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:17 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:18.223561 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:18.224293 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:18.232562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.233014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.233862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.234303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.383588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:18.393891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-98ec1b8b-0e35-4862-9bc4-036307dad9e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.174910 Nov 22 23:02:18.395152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 245/481] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:18 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:18.658758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:18.660001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:18.667374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.667827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.668828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.669429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.758817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-dca79762-3778-43da-92d8-a4169ebf0ff4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.105241 Nov 22 23:02:18.762872 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 237/482] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:18 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:18.777448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:18.778181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:18.784978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.785495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.786518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.787074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.795901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:18.796884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:18.805040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.805738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.806765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:18.807418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:18.991113 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:18.998946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6fc79bd6-ef97-42ad-b404-22b3cffd4656 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.225513 Nov 22 23:02:18.999786 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 246/483] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:18 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:19.003357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:19.005046 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:19.006234 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:19.011540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2fd47a3d-ede9-4f97-991d-d9fdab93d5d9 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.219684 Nov 22 23:02:19.018467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 238/484] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:18 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:19.018467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-2501f32e-00cf-4aac-89a7-b367157cb973 req-6839eb06-c09c-4878-bc1c-7284b28257eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25c75d2-3d2c-4c7c-99de-32fd92509971", "tag": "1525a7c6-0d24-4cce-901a-2ca8c9609c55"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:19.018985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:19.018985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:02:19.021433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.022587 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.023429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.023903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.026364 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-2501f32e-00cf-4aac-89a7-b367157cb973 req-6839eb06-c09c-4878-bc1c-7284b28257eb service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.026814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-2501f32e-00cf-4aac-89a7-b367157cb973 req-6839eb06-c09c-4878-bc1c-7284b28257eb service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.039430 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-2501f32e-00cf-4aac-89a7-b367157cb973 req-6839eb06-c09c-4878-bc1c-7284b28257eb service nova] Creating event network-changed:1525a7c6-0d24-4cce-901a-2ca8c9609c55 for instance e25c75d2-3d2c-4c7c-99de-32fd92509971 on hv-cinder-81883 Nov 22 23:02:19.044192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-2501f32e-00cf-4aac-89a7-b367157cb973 req-6839eb06-c09c-4878-bc1c-7284b28257eb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031002 Nov 22 23:02:19.044950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 239/485] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:19.052937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:19.054300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:19.060512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.060904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.061880 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.062349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.154389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-615aad6c-0b82-46a4-b57f-0fb183845761 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.152170 Nov 22 23:02:19.155364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 247/486] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:18 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:19.412547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:19.414069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:19.414569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:19.427309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a497fd60-a77d-4c05-9c35-edff072cd738 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.379929 Nov 22 23:02:19.429131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 240/487] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:19 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:19.431552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.432247 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.433142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.433759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.578380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:19.586530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-96fd8254-552d-4058-8d82-4dcea9c1eea6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.179038 Nov 22 23:02:19.589749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 248/488] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:19 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:19.770488 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:19.771461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:19.777287 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.777768 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.778549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:19.778986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:19.881839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4499e481-86ed-4742-a4a0-ca2d24f5e507 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.114789 Nov 22 23:02:19.884513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 241/489] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:19 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:20.015994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:20.016612 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:20.023071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.023524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.024430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.024758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.030705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:20.031400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:20.039346 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.039796 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.040578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.041022 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.224755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:20.228230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:20.232354 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a1358471-aded-436c-9328-77a68b2f4131 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.220022 Nov 22 23:02:20.233006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 249/490] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:20 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:20.237439 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-84ed204a-7aa1-40d4-8da9-230168bfefe8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.211484 Nov 22 23:02:20.238328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 242/491] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:20 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:20.238452 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:20.239361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:20.245335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.245757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.246567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.246996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.427751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6ae95ef1-e09a-4f53-8de3-d7f900544f5a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.193410 Nov 22 23:02:20.428390 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 250/492] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:20 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:20.443840 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:20.444449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:20.450996 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.451452 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.452239 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.452710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.584077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:20.591345 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f8ef1624-9252-4ada-a245-01f7942eafe6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.151083 Nov 22 23:02:20.591897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 243/493] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:20 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:20.603862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:20.604572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:20.611860 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.612311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.613093 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.613553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.750532 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:20.758862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f2ea27fc-26f0-4992-baf0-dd0f1ecb5867 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.159146 Nov 22 23:02:20.759422 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 251/494] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:20 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:20.893319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:20.894268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:20.900633 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.901085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:20.901908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:20.902356 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.029669 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a1aae9bd-e2c7-4d76-984a-1eaddeb788f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.139953 Nov 22 23:02:21.030313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 244/495] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:20 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:21.250144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:21.250664 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:21.253922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:21.254619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:21.257340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.257705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.258480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.258906 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.261947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.262409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.263198 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.263637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.454082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:21.458260 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:21.463121 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-754d96a8-b2cb-4946-a26c-2781e3e21b5b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.213086 Nov 22 23:02:21.463787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 245/496] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:21 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:21.466397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fb9b289a-b35a-40b5-83bd-b45621ea18cc tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.219127 Nov 22 23:02:21.466397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 252/497] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:21 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:21.468322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:21.469221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:21.475983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.476426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.477209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.477663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.586985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-961fdc14-0040-467c-be59-5586a6ca0d5d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.121962 Nov 22 23:02:21.587868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 246/498] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:21 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:21.608411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:21.609020 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:21.615456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.615907 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.616688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.617126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.748847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:21.756835 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d98e498a-c55a-4bd6-b9ce-8f15c9660e86 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.152138 Nov 22 23:02:21.757397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 253/499] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:21 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:21.775751 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:21.776436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:21.783253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.783692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.784454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:21.784885 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:21.919349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:21.927293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e1db79ac-cb55-4597-b50f-1131614bda52 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.155396 Nov 22 23:02:21.927825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 247/500] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:21 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:22.041991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:22.042956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:22.049519 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.049998 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.050768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.051202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.149861 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-82049bfb-572b-4e67-916b-9947d93e91f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.111516 Nov 22 23:02:22.150419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 254/501] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:22 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:22.481165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:22.481930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:22.483565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:22.484870 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:22.489802 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.489985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.491101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.491534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.493360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.493484 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.494299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.495038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.693052 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:22.701947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-41502b24-a7d5-414d-8532-ffe686fd1dda tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.222263 Nov 22 23:02:22.709342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 255/502] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:22 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:22.709342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-cb0f6010-4634-4c63-9cf0-8998f718be97 req-a7c85e80-6b74-49af-90b0-647c063649e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "name": "network-vif-plugged", "status": "completed", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:22.709342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:22.709342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:22.715999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-cb0f6010-4634-4c63-9cf0-8998f718be97 req-a7c85e80-6b74-49af-90b0-647c063649e1 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.716140 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-cb0f6010-4634-4c63-9cf0-8998f718be97 req-a7c85e80-6b74-49af-90b0-647c063649e1 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.718814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:22.728656 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-cb0f6010-4634-4c63-9cf0-8998f718be97 req-a7c85e80-6b74-49af-90b0-647c063649e1 service nova] Creating event network-vif-plugged:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:02:22.728880 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8ef5397d-b24b-4ffd-8a8b-73653585d16d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.251597 Nov 22 23:02:22.732397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 248/503] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:22 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:22.734464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-cb0f6010-4634-4c63-9cf0-8998f718be97 req-a7c85e80-6b74-49af-90b0-647c063649e1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030879 Nov 22 23:02:22.735269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 256/504] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:22.735805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:22.736996 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:22.743568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.744094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.744952 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.745492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.774698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:22.775426 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:22.781995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.782605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.783555 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.783989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.926169 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:22.933530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0771ed40-9976-421d-9f82-1ef85a31a9af tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.163001 Nov 22 23:02:22.934405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 257/505] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:22 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:22.943421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:22.944016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:22.947420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-50b26153-aa26-4b86-9ff1-8d817b54127b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.216227 Nov 22 23:02:22.948376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 249/506] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:22 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:22.950578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.951022 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:22.951799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:22.952279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.087568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:23.095672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a74d1521-9e83-4a3f-b8dd-3b4cc83515b1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.155130 Nov 22 23:02:23.096556 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 258/507] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:22 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:23.161307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:23.162335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:23.169509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.169992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.170773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.171209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.719076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:23.719687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:23.725013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e9f09b29-77cd-4070-9881-84b97a1f3088 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.568132 Nov 22 23:02:23.725725 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 250/508] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:23 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:23.727061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.727513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.728297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.728733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.746196 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:23.746882 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:23.753466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.753938 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.754718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.755151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.934820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:23.938328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:23.942747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f1c982c1-64e4-4bd2-bc5e-fb776d375531 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.227209 Nov 22 23:02:23.943320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 259/509] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:23 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:23.946861 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ae9452f2-2b1d-464f-9f99-8fa82e93b2cd tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.204509 Nov 22 23:02:23.947408 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 251/510] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:23 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:23.950180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:23.950841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:23.957450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.958006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.958776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.958901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:23.959356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.959801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:23.965567 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.966090 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:23.966872 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:23.967312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.073732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-722b7cf3-2ff0-4d7d-a3aa-3dacfcb30b73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.119204 Nov 22 23:02:24.077540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 252/511] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:23 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:24.091663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:24.099010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-75d45abf-6d01-4dd6-a46a-ee85be2c7b1d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1258 microversion: 2.1 time: 0.152391 Nov 22 23:02:24.099567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 260/512] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:23 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:24.113902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:24.114592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:24.123110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.123559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.124331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.124764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.260844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:24.268752 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e8c10aa0-c594-4835-be83-edb242afe073 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.158866 Nov 22 23:02:24.269322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 253/513] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:24 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:24.736977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:24.737975 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:24.744378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.744823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.745601 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.746061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.753049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-924eceb6-a116-43e1-aa86-c5b6a659f457 req-cda39e42-6cb2-4ef9-bee6-2506736d0020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee39353a-7b66-48b7-b735-20f76c7b3545", "name": "network-vif-plugged", "status": "completed", "tag": "dacb0548-77df-4148-a7b2-738040851ec4"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:24.754716 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:24.754716 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:02:24.762064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-924eceb6-a116-43e1-aa86-c5b6a659f457 req-cda39e42-6cb2-4ef9-bee6-2506736d0020 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.762470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-924eceb6-a116-43e1-aa86-c5b6a659f457 req-cda39e42-6cb2-4ef9-bee6-2506736d0020 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.773785 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-924eceb6-a116-43e1-aa86-c5b6a659f457 req-cda39e42-6cb2-4ef9-bee6-2506736d0020 service nova] Creating event network-vif-plugged:dacb0548-77df-4148-a7b2-738040851ec4 for instance ee39353a-7b66-48b7-b735-20f76c7b3545 on hv-cinder-81883 Nov 22 23:02:24.778294 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-924eceb6-a116-43e1-aa86-c5b6a659f457 req-cda39e42-6cb2-4ef9-bee6-2506736d0020 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029270 Nov 22 23:02:24.778873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 254/514] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:02:24.885075 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-39aa6de4-5bfc-49b6-a280-6c274cfa9c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.152558 Nov 22 23:02:24.885776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 261/515] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:24 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:24.961213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:24.962574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:24.965471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:24.966205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:24.969276 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.970608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.971508 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.971940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.973632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.974087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:24.974876 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:24.975312 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.190447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:25.196154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:25.199563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-905239bb-0976-490c-8212-13cf5aca4db7 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.242633 Nov 22 23:02:25.200139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 255/516] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:24 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:25.205514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5c965574-cb9e-426b-b2de-bb85fd0de733 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.243812 Nov 22 23:02:25.206099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:25.206331 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 262/517] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:24 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:25.207443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:25.210485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:25.211158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:25.214024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.214486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.215529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.215979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.221426 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.222033 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.222914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.223444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.363160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:25.371106 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-75ad10eb-fc97-476c-b3f1-32f80d121b3c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1442 microversion: 2.1 time: 0.163854 Nov 22 23:02:25.371668 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 263/518] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:25 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:25.375804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:25.376448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:25.382038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.382485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.383253 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.383683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.519596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:25.527237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0846df0d-100e-4912-afa8-14ae3bb6e471 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.154631 Nov 22 23:02:25.527848 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 264/519] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:25 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:25.532179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:25.533626 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:25.539718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.540180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.541027 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.541511 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.672865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:25.680402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-52b8524c-aeb5-41c0-be07-d7c98b93c490 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1442 microversion: 2.1 time: 0.151487 Nov 22 23:02:25.680973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 265/520] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:25 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:25.700970 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-db3a9208-9286-4201-bf24-0e3f70b985c9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.499062 Nov 22 23:02:25.701912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 256/521] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:25 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:25.896617 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:25.897628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:25.904444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.904924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:25.905733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:25.906173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.031437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cfed0997-556f-4dff-842a-ee5f1111a88f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.138530 Nov 22 23:02:26.032866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 266/522] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:25 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:26.219436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:26.221447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:26.223259 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:26.224041 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:26.228258 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.228700 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.229492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.229984 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.232460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.232460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.232720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.233200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.586316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:26.593347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:26.594351 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-33f2743b-96dd-41fd-9b91-df1a9b64c35d tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.375393 Nov 22 23:02:26.595698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 267/523] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:26 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:26.602593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:26.603344 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:26.603634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e45a6216-db29-4c0a-8bb3-1187d2470d54 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.389550 Nov 22 23:02:26.604701 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 257/524] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:26 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:26.609863 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.610429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.611709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.612261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.713000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:26.713929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:26.719711 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.720776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.721553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.722005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.852787 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:26.860534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32f270d3-33ee-4c38-ac8f-b1a1dfe2ac80 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1265 microversion: 2.1 time: 0.262238 Nov 22 23:02:26.864094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 268/525] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:26 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:26.866176 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-7b3f064a-67ff-422e-94d7-bc19e24128ca req-913dd533-4b07-47a0-8a6b-8e56ea6c558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25c75d2-3d2c-4c7c-99de-32fd92509971", "name": "network-vif-plugged", "status": "completed", "tag": "1525a7c6-0d24-4cce-901a-2ca8c9609c55"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:26.867726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:26.867726 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:26.875447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-7b3f064a-67ff-422e-94d7-bc19e24128ca req-913dd533-4b07-47a0-8a6b-8e56ea6c558d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:26.876459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-7b3f064a-67ff-422e-94d7-bc19e24128ca req-913dd533-4b07-47a0-8a6b-8e56ea6c558d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:26.887755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-7b3f064a-67ff-422e-94d7-bc19e24128ca req-913dd533-4b07-47a0-8a6b-8e56ea6c558d service nova] Creating event network-vif-plugged:1525a7c6-0d24-4cce-901a-2ca8c9609c55 for instance e25c75d2-3d2c-4c7c-99de-32fd92509971 on hv-cinder-81883 Nov 22 23:02:26.893471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-7b3f064a-67ff-422e-94d7-bc19e24128ca req-913dd533-4b07-47a0-8a6b-8e56ea6c558d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030876 Nov 22 23:02:26.894191 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2bbc2a23-8f0c-458b-8689-8cd82c572381 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.184735 Nov 22 23:02:26.894490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 269/526] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:26.898559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 258/527] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:26 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:27.045406 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:27.046355 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:27.053134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.053590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.054405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.054845 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.192996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-28fbad69-ee81-4aeb-832e-a016bd1bd1a6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.151651 Nov 22 23:02:27.194567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 270/528] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:27 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:27.612981 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:27.613999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:27.620553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:27.620964 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.621414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.621778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:27.622224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.622659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.629341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.629919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.630779 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.631327 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.929809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:27.935285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:27.943559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e96b8d2a-faf7-4b03-849f-3e7c4a723125 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.326741 Nov 22 23:02:27.944203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-162306da-a696-4c86-a147-ff249e1afd08 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.336166 Nov 22 23:02:27.952797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 271/529] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:27 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:27.952797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:27.952797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:27.955639 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 259/530] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:27 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:27.959105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.960235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.960813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:27.961327 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.961772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:27.961902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.968163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.970863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:27.971898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:27.972541 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.109771 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:28.119772 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dae8d818-920b-4201-92bc-e051969f9597 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1451 microversion: 2.1 time: 0.174030 Nov 22 23:02:28.120360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 272/531] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:27 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:28.124713 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-f51d5cf8-279f-4925-ba28-2585b28adc8d req-a98fc1eb-c2ae-460a-889f-e4ebadf600a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:28.126332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:28.126332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:28.134517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4b2468e6-65f6-42bb-93b5-790811badd7d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.177276 Nov 22 23:02:28.135011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f51d5cf8-279f-4925-ba28-2585b28adc8d req-a98fc1eb-c2ae-460a-889f-e4ebadf600a1 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.135560 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 260/532] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:27 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:28.135676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f51d5cf8-279f-4925-ba28-2585b28adc8d req-a98fc1eb-c2ae-460a-889f-e4ebadf600a1 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.140246 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:28.140986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:28.148789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.149241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.150063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.150501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.153748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-f51d5cf8-279f-4925-ba28-2585b28adc8d req-a98fc1eb-c2ae-460a-889f-e4ebadf600a1 service nova] Creating event network-changed:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:02:28.159494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-f51d5cf8-279f-4925-ba28-2585b28adc8d req-a98fc1eb-c2ae-460a-889f-e4ebadf600a1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037913 Nov 22 23:02:28.160107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 273/533] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:28.205789 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:28.206706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:28.216366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.216818 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.217631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.218081 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.315188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:28.325259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-21d20010-a4d8-4d64-98b7-8dcecc61dd25 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1451 microversion: 2.1 time: 0.188840 Nov 22 23:02:28.329853 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 261/534] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:28 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:28.338016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e3c32c24-3dac-481b-ac94-0f92c0694169 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.136544 Nov 22 23:02:28.339138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 274/535] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:28 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:28.960454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:28.962470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:28.962642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:28.963424 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:28.971367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.971794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.971934 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.972814 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.973365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.973908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:28.975229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:28.976390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:29.333334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:29.339421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:29.340944 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-aa16b8be-7ded-403d-b757-c01a601a5bdb tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1314 microversion: 2.1 time: 0.384412 Nov 22 23:02:29.350941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 262/536] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:28 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:29.350941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:29.350941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:29.354021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:29.354516 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:29.355254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:29.355709 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:29.362128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-394a82dd-827c-4ef1-8e55-d20064497fc5 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.403190 Nov 22 23:02:29.371473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 275/537] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:28 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:29.371473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:29.371473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:29.376269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:29.377162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:29.378295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:29.378737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:29.461298 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e787c896-8f3f-41e1-a3d5-2dbf0d2bacc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.118126 Nov 22 23:02:29.465311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 263/538] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:29 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:29.494740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7f4451c9-a40b-4fae-8125-18342c7bdcca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.130230 Nov 22 23:02:29.495991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 276/539] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:29 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:30.231657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-fc8dd6ab-f3e5-4119-8996-bcf6dcd3b1a0 req-2e64cd6e-2147-4eb3-bb0e-dea18c183239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee39353a-7b66-48b7-b735-20f76c7b3545", "tag": "dacb0548-77df-4148-a7b2-738040851ec4"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:30.233229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:30.233229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:02:30.242161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-fc8dd6ab-f3e5-4119-8996-bcf6dcd3b1a0 req-2e64cd6e-2147-4eb3-bb0e-dea18c183239 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.242846 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-fc8dd6ab-f3e5-4119-8996-bcf6dcd3b1a0 req-2e64cd6e-2147-4eb3-bb0e-dea18c183239 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.255640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-fc8dd6ab-f3e5-4119-8996-bcf6dcd3b1a0 req-2e64cd6e-2147-4eb3-bb0e-dea18c183239 service nova] Creating event network-changed:dacb0548-77df-4148-a7b2-738040851ec4 for instance ee39353a-7b66-48b7-b735-20f76c7b3545 on hv-cinder-81883 Nov 22 23:02:30.260568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-fc8dd6ab-f3e5-4119-8996-bcf6dcd3b1a0 req-2e64cd6e-2147-4eb3-bb0e-dea18c183239 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033351 Nov 22 23:02:30.261424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 264/540] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:30.358748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:30.359401 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:30.367764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.368221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.369046 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.369703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.380304 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:30.381023 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:30.389699 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.390159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.396988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.397456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.610913 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:30.613845 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:30.621208 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aaec3ac8-643b-4949-b64a-6c61ae77ca2b tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1499 microversion: 2.1 time: 0.266750 Nov 22 23:02:30.621831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 277/541] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:30 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:30.623019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-100ea903-ae09-49da-a1df-b83d5415a0a4 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.247101 Nov 22 23:02:30.632800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:30.632800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:30.633661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 265/542] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:30 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:30.638617 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:30.641159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:30.641794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.642256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.643052 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.643482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.650645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.651402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.652408 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:30.653060 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:30.769202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bf3d00f6-41c6-4f53-b851-6c07d6e46dc2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.146115 Nov 22 23:02:30.770364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 278/543] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:30 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:30.787380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-974e18a9-6f71-4d86-9615-060153eae092 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.152040 Nov 22 23:02:30.788185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 266/544] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:30 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:31.187450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:31.188027 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:31.195048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.195506 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.196677 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.197447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.226190 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:02:31.322592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0cd0759d-6af5-4558-a093-d24828833463 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 204 len: 0 microversion: 2.1 time: 0.139093 Nov 22 23:02:31.323357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 279/545] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:02:31 2021] DELETE /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:02:31.332957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:31.333735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:31.342549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.343091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.343951 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.344397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.640811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:31.642128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:31.649339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.649855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.650815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.651567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.690158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:31.697937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f2cacffd-1091-4588-a6ee-a657b60fd633 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1505 microversion: 2.1 time: 0.369914 Nov 22 23:02:31.698513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 267/546] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:31 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:31.780864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:31.782118 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:31.786313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:31.789017 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.789471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.790286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.790720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.795908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-83af31eb-325a-4f7f-8c1b-8c8c6546aa9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.158009 Nov 22 23:02:31.795908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 280/547] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:31 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:31.801075 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:31.802147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:31.808462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.808912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.809777 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:31.810216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:31.905029 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6da701fd-763a-4445-9b38-59e36baa626f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.127667 Nov 22 23:02:31.905722 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 268/548] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:31 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:31.921047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5d370923-f11c-44cb-b8dd-5d748c6dd4d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28609 microversion: 2.20 time: 0.123225 Nov 22 23:02:31.921715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 281/549] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:31 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28609 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:32.716247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:32.716954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:32.726132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:32.726732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:32.727879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:32.728420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:32.813393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:32.814799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:32.823102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:32.824416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:32.825377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:32.826123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:32.885981 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:32.894204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-90e77577-4456-42ea-bb6b-9d38b118c1a6 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1505 microversion: 2.1 time: 0.182039 Nov 22 23:02:32.894771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 269/550] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:32 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:32.917724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:32.918754 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:32.924842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:32.925293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:32.926134 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:32.926569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:32.980693 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:32.988796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c7ff76bd-90f3-4c5c-954b-cef7ef0ff1da tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.180237 Nov 22 23:02:32.989356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 282/551] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:32 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:32.993718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:32.994686 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:33.000044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:33.000487 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:33.001989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:33.002420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:33.335531 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b2eb3110-a0c1-4a42-9a7b-c7619414abf9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 28682 microversion: 2.1 time: 0.421705 Nov 22 23:02:33.336171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 270/552] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:32 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 28682 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:33.364894 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-673488a3-726f-4556-9ead-d4b10a94a508 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 28976 microversion: 2.20 time: 0.374184 Nov 22 23:02:33.365559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 283/553] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:32 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 28976 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:33.912190 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:33.912827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:33.919979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:33.920437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:33.921218 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:33.921692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.006386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:34.007084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:34.014348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.014815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.015653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.016102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.059421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:34.067340 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-026ffa94-821f-4fe4-818d-365bd7498c86 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1505 microversion: 2.1 time: 0.159111 Nov 22 23:02:34.077144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 271/554] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:33 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:34.163312 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:34.171922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a7ab34d8-7c77-4064-ae54-bce18961ce1c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1567 microversion: 2.1 time: 0.169492 Nov 22 23:02:34.173154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 284/555] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:34 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:34.347396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:34.348331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:34.354978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.355537 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.356348 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.356840 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.383580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:34.384504 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:34.398817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.399275 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.400080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.400514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.512289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3062359b-a104-4146-b838-4cda4be588f7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 29396 microversion: 2.1 time: 0.168535 Nov 22 23:02:34.512858 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 272/556] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:34 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 29396 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:34.592014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-eddb876c-46e8-435d-ad97-6bb186dce532 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 30423 microversion: 2.20 time: 0.211888 Nov 22 23:02:34.596493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 285/557] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:34 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 30423 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:34.641116 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-af1862d0-06a8-4d04-8254-e97a4ba3f9f5 req-173152db-db98-4457-b720-177efc2fde63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25c75d2-3d2c-4c7c-99de-32fd92509971", "name": "network-vif-deleted", "tag": "1525a7c6-0d24-4cce-901a-2ca8c9609c55"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:34.643457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:34.643457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:02:34.651553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-af1862d0-06a8-4d04-8254-e97a4ba3f9f5 req-173152db-db98-4457-b720-177efc2fde63 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:34.651999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-af1862d0-06a8-4d04-8254-e97a4ba3f9f5 req-173152db-db98-4457-b720-177efc2fde63 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:34.663803 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-af1862d0-06a8-4d04-8254-e97a4ba3f9f5 req-173152db-db98-4457-b720-177efc2fde63 service nova] Creating event network-vif-deleted:1525a7c6-0d24-4cce-901a-2ca8c9609c55 for instance e25c75d2-3d2c-4c7c-99de-32fd92509971 on hv-cinder-81883 Nov 22 23:02:34.668491 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-af1862d0-06a8-4d04-8254-e97a4ba3f9f5 req-173152db-db98-4457-b720-177efc2fde63 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031355 Nov 22 23:02:34.669064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 273/558] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:35.085826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:35.086585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.093645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.094122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.094986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.095416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.126903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.127265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.127707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lazy-loading 'fault' on Instance uuid e25c75d2-3d2c-4c7c-99de-32fd92509971 {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:02:35.171135 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f494ba6b194db1915c334280aa724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1734d6e5ada24e74857dbeaf2a19d2ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:35.178949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-65eea1d1-b4a4-4d85-a0b3-fda15a63c788 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 200 len: 1304 microversion: 2.1 time: 0.097408 Nov 22 23:02:35.179504 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 286/559] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:35 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:35.190740 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:35.191443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.197566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.198046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.198852 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.199343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.340185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:35.347974 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c107cf62-63bc-4580-8617-af8e0b6912a1 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1547 microversion: 2.1 time: 0.162617 Nov 22 23:02:35.348565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 274/560] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:35 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:35.377935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:35.378729 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.389050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.389592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.390470 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.390912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.515946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] HTTP exception thrown: Cannot 'detach_volume' instance 51cf0f00-ab35-48da-bd27-6fba3194dcff while it is in vm_state rescued Nov 22 23:02:35.516562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Returning 409 to user: Cannot 'detach_volume' instance 51cf0f00-ab35-48da-bd27-6fba3194dcff while it is in vm_state rescued {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:02:35.517434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c424b1f0-bf4a-4a69-af58-045f294e9c11 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments/e3c12616-b5f8-4da9-b776-4c7033d5ecbc" status: 409 len: 152 microversion: 2.1 time: 0.147633 Nov 22 23:02:35.518053 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 287/561] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:02:35 2021] DELETE /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments/e3c12616-b5f8-4da9-b776-4c7033d5ecbc => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 22 23:02:35.523568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:35.524686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.529024 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:35.529579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.531031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.531487 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.532293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.532725 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.535680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.536135 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.536917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.537355 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.601144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bbdc4865-b186-457e-9781-073a1c2d5c9b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action" status: 202 len: 0 microversion: 2.1 time: 0.078585 Nov 22 23:02:35.601858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 288/562] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:35 2021] POST /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:35.607091 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:35.608138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.614748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.615198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.615975 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.616413 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.630394 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-95c89eae-4703-48b1-bc4d-a62492f62abd tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 30691 microversion: 2.1 time: 0.110314 Nov 22 23:02:35.632332 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 275/563] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:35 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 30691 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:02:35.636999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:35.637753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:35.645469 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.645955 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.646773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:35.647215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:35.771702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3a5c63dc-13ff-444e-9f22-f1c534a0a1ee tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 31800 microversion: 2.20 time: 0.168487 Nov 22 23:02:35.773308 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 289/564] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:35 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 31800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:35.788774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:35.796813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1004d5cc-aa43-460a-aa74-e88c9672862c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1555 microversion: 2.1 time: 0.163574 Nov 22 23:02:35.797409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 276/565] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:35 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:36.196888 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:36.197512 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] [instance: e25c75d2-3d2c-4c7c-99de-32fd92509971] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:36.205158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.205607 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.206418 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.206858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.221644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] HTTP exception thrown: Instance e25c75d2-3d2c-4c7c-99de-32fd92509971 could not be found. Nov 22 23:02:36.222237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] Returning 404 to user: Instance e25c75d2-3d2c-4c7c-99de-32fd92509971 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:02:36.223073 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-932aefb3-478b-44ef-a100-81e19e8e79c5 tempest-VolumesActionsTest-2481910 tempest-VolumesActionsTest-2481910-project] 10.222.0.81 "GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971" status: 404 len: 111 microversion: 2.1 time: 0.030350 Nov 22 23:02:36.223881 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 290/566] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:36 2021] GET /compute/v2.1/servers/e25c75d2-3d2c-4c7c-99de-32fd92509971 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:02:36.644358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:36.645279 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:36.651595 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.652054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.652847 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.653296 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.783876 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:36.785050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:36.791661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.792110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.792883 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.793313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.819966 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-60ae1638-d90b-4a9e-8be4-9b08895527f4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 32201 microversion: 2.1 time: 0.180066 Nov 22 23:02:36.821558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 277/567] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:36 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 32201 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:36.825757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:36.826470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:36.834509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.834964 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.835750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:36.836229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:36.929433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-55048436-d3d0-4738-a35e-0f6ca873cb27 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 32988 microversion: 2.20 time: 0.149204 Nov 22 23:02:36.930970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 291/568] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:36 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 32988 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:36.980467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:36.988394 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1c244ad2-05ca-4240-a0b2-7d9ce8b1e27c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1555 microversion: 2.1 time: 0.166605 Nov 22 23:02:36.988953 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 278/569] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:36 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:37.832227 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:37.833248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:37.840176 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:37.840633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:37.841405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:37.841875 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:37.943115 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:37.943946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:37.950231 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:37.950685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:37.951466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:37.951903 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:41.623265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8d805544-d642-46b4-a00d-440c6b9feb9f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 37682 microversion: 2.1 time: 3.794967 Nov 22 23:02:41.624353 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 292/570] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:37 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 37682 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:41.629179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:41.629891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:41.637440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:41.637924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:41.638697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:41.639126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:41.784245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:41.793303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-001b835f-452e-47ce-87a5-256453dee492 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1555 microversion: 2.1 time: 0.167917 Nov 22 23:02:41.793928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 293/571] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:41 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:41.996150 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4359f724-5bce-47a9-9f7a-2fcbe14cf8ea tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 36590 microversion: 2.20 time: 4.057170 Nov 22 23:02:41.996719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 279/572] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:37 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 36590 bytes in 4059 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:42.635321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:42.636298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:42.643866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:42.644318 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:42.645103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:42.645589 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:42.752530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aeb6e419-fb36-4e40-937a-ad165249c005 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 38183 microversion: 2.1 time: 0.120750 Nov 22 23:02:42.753739 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 294/573] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:42 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 38183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:42.811100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:42.811789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:42.819255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:42.819706 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:42.820481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:42.820918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:42.952451 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:42.961127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-056c888e-4283-4f0a-9622-d506be9cc540 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1555 microversion: 2.1 time: 0.153993 Nov 22 23:02:42.961715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 280/574] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:42 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:43.008470 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:43.009461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:43.016805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:43.017340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:43.018146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:43.018584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:43.143711 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0d39ed73-19cb-4391-a67c-b8ada90b04d2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 37492 microversion: 2.20 time: 0.139189 Nov 22 23:02:43.144363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 295/575] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:43 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 37492 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:43.764164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:43.765077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:43.771843 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:43.772314 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:43.773088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:43.773661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:43.918355 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d0210565-338c-4502-ab01-4e0dc224b71d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 38203 microversion: 2.1 time: 0.157622 Nov 22 23:02:43.919113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 281/576] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:43 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 38203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:43.978939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:43.979660 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:43.986831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:43.987292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:43.988080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:43.988524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:44.153932 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:44.155837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:44.157117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:44.163180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3aa40f5a-f606-4dca-90dc-87200e07ce5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1555 microversion: 2.1 time: 0.188181 Nov 22 23:02:44.164016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 296/577] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:43 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:44.176779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:44.177236 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:44.178066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:44.178680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:44.334074 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d1c1da5e-84b9-4bab-9f6a-c61cdf7074ae tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 38113 microversion: 2.20 time: 0.181937 Nov 22 23:02:44.335205 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 282/578] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:44 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 38113 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:44.930455 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:44.931376 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:44.938010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:44.938473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:44.939261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:44.939691 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.063419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d57be4f8-3119-4b37-badc-52748edf9cc6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 38203 microversion: 2.1 time: 0.136392 Nov 22 23:02:45.068203 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 297/579] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:44 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 38203 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:45.181308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:45.182648 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:45.190511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.191286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.192153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.192666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.348320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:45.349838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:45.358277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.359288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.361597 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.362305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.429335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:45.437765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e1549de6-e8c0-4ffa-aeab-4a841471202c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1561 microversion: 2.1 time: 0.260367 Nov 22 23:02:45.446001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 283/580] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:45 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1561 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:45.488162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-88431d1e-5830-4c8b-8e03-c4ad442183f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 38166 microversion: 2.20 time: 0.144920 Nov 22 23:02:45.489778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 298/581] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:45 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 38166 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:45.522521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:45.523015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:45.533001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.533452 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.534389 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.534738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.665846 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lazy-loading 'services' on Instance uuid 51cf0f00-ab35-48da-bd27-6fba3194dcff {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:02:45.790942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-40284eef-df3b-45c3-9407-956b8853522a tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments/e3c12616-b5f8-4da9-b776-4c7033d5ecbc" status: 202 len: 0 microversion: 2.1 time: 0.271803 Nov 22 23:02:45.791693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 284/582] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:02:45 2021] DELETE /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments/e3c12616-b5f8-4da9-b776-4c7033d5ecbc => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:45.805549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:45.807283 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:45.818513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.819161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.820048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:45.820551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:45.861089 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a0228566-8cf3-4084-a3c4-9c8698045e31 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064749 Nov 22 23:02:45.861984 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 299/583] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:02:45 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:46.076836 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:46.077902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:46.085436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:46.086366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:46.087438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:46.087877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:46.205790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c7e19d91-d89c-42ff-bd89-2a377bfa2363 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 38203 microversion: 2.1 time: 0.134406 Nov 22 23:02:46.207159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 285/584] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:46 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 38203 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:46.501797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:46.502943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:46.523298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:46.524277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:46.525205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:46.525658 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:46.708761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1e97f411-d445-44b6-88b8-d0b5c261148c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 38166 microversion: 2.20 time: 0.207364 Nov 22 23:02:46.710980 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 300/585] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:46 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 38166 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:46.873369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:46.874418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:46.883251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:46.884079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:46.885888 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:46.886559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:46.929280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a8243c06-659f-48bb-a3b5-df7442a97826 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059769 Nov 22 23:02:46.931040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 286/586] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:02:46 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:47.217892 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:47.219641 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:47.227503 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.228180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.229031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.229505 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.350059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8cc1cfa7-4b7d-4404-aafc-1b3d5469eb12 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 38203 microversion: 2.1 time: 0.135890 Nov 22 23:02:47.355240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 301/587] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:47 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 38203 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:47.718640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:47.720562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:47.726801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.727195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.728053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.728748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.843906 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e246c2a4-66fb-433a-ba4b-f4a4ead49a57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 200 len: 38309 microversion: 2.20 time: 0.128804 Nov 22 23:02:47.846468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 287/588] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:47 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 38309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:02:47.860849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:47.864516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:47.874225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.874811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.876392 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.876838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.909200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32afa1a0-0273-4bae-8734-ff499b19c8a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/ips" status: 200 len: 152 microversion: 2.20 time: 0.056542 Nov 22 23:02:47.915482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 302/589] 10.222.0.81 () {60 vars in 1288 bytes} [Mon Nov 22 23:02:47 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/ips => generated 152 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:47.946453 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:47.948007 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:47.958763 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.959221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:47.960017 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:47.960457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:48.002178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c088f9cc-6141-47d5-9332-791bd5ae4e5c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063440 Nov 22 23:02:48.002712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 288/590] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:02:47 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:02:48.364939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:48.365887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:48.372371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:48.372829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:48.373648 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:48.374074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:48.480638 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6ead275c-935e-40cc-ae5a-7005338bd886 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 200 len: 38332 microversion: 2.1 time: 0.120286 Nov 22 23:02:48.481233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 303/591] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:48 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 38332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:02:48.491237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:48.491727 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:48.498119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:48.498574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:48.499373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:48.499816 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:48.523053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-480f7bdc-32f6-42f7-8c27-0ca36a250351 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/ips" status: 200 len: 147 microversion: 2.1 time: 0.035466 Nov 22 23:02:48.523612 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 289/592] 10.222.0.81 () {58 vars in 1247 bytes} [Mon Nov 22 23:02:48 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:50.407579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:50.408714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:50.446627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.446627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.446627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.446627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.447148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:50.447148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:50.447148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.447950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.448155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.448806 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.468139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:02:50.481977 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lazy-loading 'flavor' on Instance uuid 6383769b-dc5f-4c00-9651-484e2904efcc {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:02:50.590016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e6432848-401b-4bd3-9f92-43de11e3f458 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 204 len: 0 microversion: 2.1 time: 0.194881 Nov 22 23:02:50.590599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 304/593] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:02:50 2021] DELETE /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:02:50.599865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:50.600567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:50.606881 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.607077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.607986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.608429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.810096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:50.821233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-57dfb829-53e1-4d1d-ae06-898eed112082 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1507 microversion: 2.1 time: 0.225147 Nov 22 23:02:50.827535 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 305/594] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:50 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:50.851383 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-252178a1-7a67-41f5-b2fe-6c014760c0cf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 202 len: 0 microversion: 2.20 time: 0.444757 Nov 22 23:02:50.852375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 290/595] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:02:50 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:02:50.861934 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:50.862605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:50.881180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.881633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:50.883026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:50.883471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:51.039011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:51.046495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:51.048063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:51.049210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d74ccbc7-4e78-43fa-8a12-1f7de1ccb6c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.192203 Nov 22 23:02:51.049796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 306/596] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:50 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:51.839096 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:51.839914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:51.847373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:51.847840 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:51.848686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:51.849153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:51.996841 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:52.005213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-38196a5d-8098-4ca5-bb3d-a439a6b01b36 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1507 microversion: 2.1 time: 0.170546 Nov 22 23:02:52.006586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 291/597] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:51 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:52.072023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:52.077915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:52.090585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:52.095045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:52.096488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:52.097140 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:52.296909 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:52.306350 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:52.307955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:52.310811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-70c06d9b-2724-4338-b8f4-0fda8f4c79f0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.242115 Nov 22 23:02:52.322681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 307/598] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:52 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:52.862544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a05ec09-4c63-4959-aaee-67761b939491"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:52.864221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:52.876384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:52.876849 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:52.877707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:52.878354 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:53.024257 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:53.024822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:53.031111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:53.032198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:53.032994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:53.033428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:53.189546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:53.201805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1d9e3cb3-9444-4340-a3a4-b2e2f309ed16 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1507 microversion: 2.1 time: 0.180723 Nov 22 23:02:53.202983 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 308/599] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:53 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:53.229833 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d5e61d3e-54a1-4842-9120-6555b73cd1c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372172 Nov 22 23:02:53.231292 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 292/600] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:02:52 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:02:53.332264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:53.333095 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:53.341074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:53.341917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:53.344889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:53.344889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:53.511355 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:53.519829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:53.521305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:53.522604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7990da2f-c5c2-4cdb-a92f-4aeed99d5ec1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.195856 Nov 22 23:02:53.523258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 309/601] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:53 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:54.220947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:54.221636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:54.228357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:54.228811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:54.229601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:54.230075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:54.449423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:54.458417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-370da139-f472-4ac9-9b71-32faa05d7cfc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1507 microversion: 2.1 time: 0.241836 Nov 22 23:02:54.459007 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 293/602] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:54 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:54.541712 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:54.542286 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:54.548941 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:54.549388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:54.550189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:54.550646 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:54.705923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:54.718683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:54.720935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:54.722145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2743d51c-a1df-4f0f-a020-477299733a45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.184584 Nov 22 23:02:54.722697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 310/603] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:54 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:55.476695 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:55.477318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:55.487591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-3e931307-1293-4f0f-b2fc-1b8bd2a4d522 req-349cad7d-9cbf-4b4d-acf4-9a2fe037c542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13394410-ae52-4acb-8d11-e061a4ae89a3", "name": "network-vif-deleted", "tag": "00b76964-7845-4ede-805d-663e9d646d8b"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:55.489278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:02:55.489278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:02:55.510357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:55.510883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:55.511711 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:55.512147 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:55.517927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-3e931307-1293-4f0f-b2fc-1b8bd2a4d522 req-349cad7d-9cbf-4b4d-acf4-9a2fe037c542 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:55.517927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-3e931307-1293-4f0f-b2fc-1b8bd2a4d522 req-349cad7d-9cbf-4b4d-acf4-9a2fe037c542 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:55.550684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-3e931307-1293-4f0f-b2fc-1b8bd2a4d522 req-349cad7d-9cbf-4b4d-acf4-9a2fe037c542 service nova] Creating event network-vif-deleted:00b76964-7845-4ede-805d-663e9d646d8b for instance 13394410-ae52-4acb-8d11-e061a4ae89a3 on hv-cinder-81883 Nov 22 23:02:55.557525 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-3e931307-1293-4f0f-b2fc-1b8bd2a4d522 req-349cad7d-9cbf-4b4d-acf4-9a2fe037c542 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073776 Nov 22 23:02:55.563831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 311/604] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:02:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:02:55.592739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:55.602880 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-864b6dd6-508f-42e9-8bd8-09c1ff44751c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 200 len: 1293 microversion: 2.1 time: 0.130507 Nov 22 23:02:55.603886 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 294/605] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:55 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:02:55.741254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:55.742143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:55.753677 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:55.754436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:55.755510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:55.756692 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:55.929574 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:55.938819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:55.940306 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:55.941541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-262bc149-0c7e-4d92-a769-da9250be7e69 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.204445 Nov 22 23:02:55.942407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 312/606] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:55 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:56.629334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:56.641918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 13394410-ae52-4acb-8d11-e061a4ae89a3] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:56.647663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ab28ae73-906e-4a65-87b7-dc8d7bb724e3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:02:56.648942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.649670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.650649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.651434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.660841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ab28ae73-906e-4a65-87b7-dc8d7bb724e3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.661294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ab28ae73-906e-4a65-87b7-dc8d7bb724e3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.666056 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] HTTP exception thrown: Instance 13394410-ae52-4acb-8d11-e061a4ae89a3 could not be found. Nov 22 23:02:56.666738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Returning 404 to user: Instance 13394410-ae52-4acb-8d11-e061a4ae89a3 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:02:56.667774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9f2b55b5-9400-49de-b09c-a3d0e08e0439 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3" status: 404 len: 111 microversion: 2.1 time: 0.049413 Nov 22 23:02:56.668610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 295/607] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:56 2021] GET /compute/v2.1/servers/13394410-ae52-4acb-8d11-e061a4ae89a3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:02:56.677416 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:56.678381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:56.684877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.685662 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.686705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.687361 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.715275 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:02:56.733958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ab28ae73-906e-4a65-87b7-dc8d7bb724e3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Going to try to stop instance {{(pid=116339) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 23:02:56.788398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ab28ae73-906e-4a65-87b7-dc8d7bb724e3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 202 len: 0 microversion: 2.1 time: 0.143868 Nov 22 23:02:56.791818 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 313/608] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:02:56 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:02:56.797397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:56.798385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:56.806121 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.806456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.807255 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.807754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.811281 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f5af4b82-7b99-4abc-a60f-133b53be46ed tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "DELETE /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 204 len: 0 microversion: 2.1 time: 0.137036 Nov 22 23:02:56.813679 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 296/609] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:02:56 2021] DELETE /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:02:56.822868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:56.823891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:56.832460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.833266 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:56.834622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:56.835522 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:57.020915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:57.048646 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7e84e71f-59c1-468e-8506-2402236c3502 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.254963 Nov 22 23:02:57.050747 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:57.058586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7feb8ce0-a5bb-46d5-98ac-b0a79d3521db tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.240743 Nov 22 23:02:57.059928 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 297/610] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:56 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:57.060757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 314/611] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:56 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:57.065511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:57.066145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:57.072268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:57.072715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:57.073530 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:57.074095 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:57.216264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:57.225005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:57.227119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:57.228637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1af287cc-ee55-460d-8a6a-247a6d6f31d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.167528 Nov 22 23:02:57.229280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 298/612] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:57 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:58.067859 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:58.068721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:58.076852 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:58.077294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:58.078712 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:58.079258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:58.088441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:58.088441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:58.092588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:58.093041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:58.095325 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:58.095672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:58.338776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:58.348464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-19faee08-c4cb-4e6a-b054-220631d99a8c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.285423 Nov 22 23:02:58.349923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 315/613] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:58 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:58.354359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:58.354954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:58.361456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:58.361933 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:58.363086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:58.363527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:58.374783 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:58.384954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cd3032fa-0059-4b3f-aa0b-5069f188e78c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.304028 Nov 22 23:02:58.386184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 299/614] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:58 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:58.531035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:58.541386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:58.542883 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:58.544201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b520e845-89e9-4bd8-95f0-87929a3a4831 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.193341 Nov 22 23:02:58.549963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 316/615] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:58 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:02:59.365642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:59.366323 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:59.375448 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:59.376281 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:59.376792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:59.377315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:59.402762 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:59.404597 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:59.411749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:59.412565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:59.413728 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:59.414262 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:59.635784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:59.636498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:59.644542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-81a1f7a2-a694-4c3a-a60f-5ebdc22cc946 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.282400 Nov 22 23:02:59.645322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 300/616] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:59 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:59.647315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f7770c37-677e-4faf-bd4d-0db54ff78399 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.248390 Nov 22 23:02:59.648278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 317/617] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:02:59 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:02:59.649544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:02:59.650844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:02:59.657945 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:59.658499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:59.659467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:02:59.660002 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:02:59.809780 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:59.818358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:59.820468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:02:59.821538 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c9e22ea8-6a4f-4a4f-9da0-42c4b27a6820 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.175492 Nov 22 23:02:59.822409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 301/618] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:02:59 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:00.665651 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:00.666572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:00.675048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:00.676503 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:00.680924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:00.681295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:00.682143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:00.682595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:00.686289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:00.686825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:00.688203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:00.688705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:00.955666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:00.971752 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5655195e-ab8e-4c68-9bd5-6222e493bfb8 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.308152 Nov 22 23:03:00.986779 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 318/619] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:00 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:00.994388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:00.995254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:00.999804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:01.002436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:01.002874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:01.003716 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:01.004118 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:01.015336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-95724a88-d582-4c95-a37f-af482eed8541 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.345178 Nov 22 23:03:01.016835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 302/620] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:00 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:01.156977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:01.165738 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:01.167230 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:01.168405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b81e2a8c-cad6-4e73-b4b4-4d6aa1598d2f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.179147 Nov 22 23:03:01.168978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 319/621] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:00 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:01.989164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:01.989803 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:01.996120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:01.996568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:01.997343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:01.997815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:02.033327 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:02.033961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:02.040804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:02.041258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:02.042193 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:02.042633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:02.182855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:02.190657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1cfecf40-5f81-4da3-a98b-d4d48241d49c tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.205223 Nov 22 23:03:02.191449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 303/622] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:01 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:02.195600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:02.196195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:02.201874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:02.202324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:02.203710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:02.204462 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:02.224127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:02.232441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9a5c79d4-4b97-4dbe-8124-c91a3a474c79 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.203499 Nov 22 23:03:02.233161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 320/623] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:02 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:02.337353 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:02.345271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:02.346827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:02.348006 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-83e23e0d-ae36-4204-b384-170bb23dfaf0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.155843 Nov 22 23:03:02.348569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 304/624] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:02 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:03.213844 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:03.214531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:03.221488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:03.221989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:03.222777 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:03.223220 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:03.249473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:03.250569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:03.257458 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:03.257999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:03.258879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:03.259412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:03.398478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:03.406874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aa2da70b-0a54-406d-9d0f-81712b7c039f tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.202111 Nov 22 23:03:03.407448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 321/625] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:03 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:03.412555 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:03.413939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:03.420020 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:03.420469 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:03.421270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:03.421778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:03.434735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:03.442889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9b93c567-0027-48cf-abd9-9aeef94569d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.196933 Nov 22 23:03:03.443462 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 305/626] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:03 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:03.558281 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:03.567582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:03.569073 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:03.570292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-67a0d020-682a-4b86-84d0-8eaac199fc10 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.161933 Nov 22 23:03:03.570849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 322/627] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:03 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:04.423863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:04.424478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:04.430684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:04.431128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:04.431901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:04.432334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:04.462393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:04.463002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:04.479670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:04.480036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:04.480846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:04.481271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:04.623864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:04.633215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e45809a4-214a-4182-bb2a-70d881124abc tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1521 microversion: 2.1 time: 0.213072 Nov 22 23:03:04.644077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 306/628] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:04 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:04.644077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:04.644077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:04.645746 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:04.646209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:04.647424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:04.647424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:04.672748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:04.680859 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b89175fc-f46f-472e-b0d3-fbd9fcf831cb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.221992 Nov 22 23:03:04.681554 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 323/629] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:04 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:04.790120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:04.799191 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:04.800696 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:04.801904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ced99b99-c1af-484a-8ae9-eb081698508a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.166770 Nov 22 23:03:04.802466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 307/630] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:04 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:05.299216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-ecb7230e-6849-46e7-b440-50965bacf248 req-609db847-74c9-4521-9edd-324010b088af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cf0f00-ab35-48da-bd27-6fba3194dcff", "name": "network-vif-deleted", "tag": "4d61dd9a-fb6c-4061-9f0b-4ccda1fd6948"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:05.299216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:03:05.299216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:03:05.305324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-ecb7230e-6849-46e7-b440-50965bacf248 req-609db847-74c9-4521-9edd-324010b088af service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.305868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-ecb7230e-6849-46e7-b440-50965bacf248 req-609db847-74c9-4521-9edd-324010b088af service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.318518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-ecb7230e-6849-46e7-b440-50965bacf248 req-609db847-74c9-4521-9edd-324010b088af service nova] Creating event network-vif-deleted:4d61dd9a-fb6c-4061-9f0b-4ccda1fd6948 for instance 51cf0f00-ab35-48da-bd27-6fba3194dcff on hv-cinder-81883 Nov 22 23:03:05.324103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-ecb7230e-6849-46e7-b440-50965bacf248 req-609db847-74c9-4521-9edd-324010b088af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034514 Nov 22 23:03:05.325786 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 324/631] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:03:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:05.650558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:05.651274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:05.657638 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.658094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.658880 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.659318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.692267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.692720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.693462 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lazy-loading 'fault' on Instance uuid 51cf0f00-ab35-48da-bd27-6fba3194dcff {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:03:05.698713 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:05.699924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:05.706267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.706724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.707507 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.707945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.738427 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd348368113a04946a77be06091feb5e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfa9a861da442f688818dd77f89bf9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:05.756168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f123ca76-4bb7-42f1-96a3-564701fedb39 tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 200 len: 1312 microversion: 2.1 time: 0.109141 Nov 22 23:03:05.756933 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 308/632] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:05 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:05.820672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:05.822302 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:05.835870 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.836721 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.837820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:05.838329 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:05.855744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:05.863966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b1b3d088-b7db-4fc8-bc75-d94757e080c0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.169239 Nov 22 23:03:05.874150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 325/633] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:05 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:06.000519 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:06.008466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:06.010050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:06.011200 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-95198bf5-7b0d-430a-b22d-f50c51b30930 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.194909 Nov 22 23:03:06.011749 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 309/634] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:05 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:06.772506 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:06.773342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] [instance: 51cf0f00-ab35-48da-bd27-6fba3194dcff] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:06.780443 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:06.780888 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:06.782298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:06.783015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:06.797822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] HTTP exception thrown: Instance 51cf0f00-ab35-48da-bd27-6fba3194dcff could not be found. Nov 22 23:03:06.798397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] Returning 404 to user: Instance 51cf0f00-ab35-48da-bd27-6fba3194dcff could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:03:06.799235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-272cf7f0-c2c2-41eb-af1e-0ed6ae518d7b tempest-ServerRescueNegativeTestJSON-1430659415 tempest-ServerRescueNegativeTestJSON-1430659415-project] 10.222.0.81 "GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff" status: 404 len: 111 microversion: 2.1 time: 0.030607 Nov 22 23:03:06.801673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 326/635] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:06 2021] GET /compute/v2.1/servers/51cf0f00-ab35-48da-bd27-6fba3194dcff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:03:06.881185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:06.882444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:06.890914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:06.891842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:06.892915 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:06.893818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:07.030525 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:07.031162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:07.041456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:07.046018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:07.047467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:07.048160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:07.065024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:07.073967 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0aeddbd6-810f-4f80-83c3-d81b81aebe43 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.196298 Nov 22 23:03:07.087146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 310/636] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:06 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:07.213535 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:07.221283 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:07.222797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:07.223963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f81923fe-9660-46a9-ac7d-f9362ec20e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.197043 Nov 22 23:03:07.224513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 327/637] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:07 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:03:08.093950 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:08.095529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:08.102520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:08.103162 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:08.103992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:08.104432 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:08.191348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1520769643", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "3f3ce0b9-727f-4320-a712-09bd6fad8f0f"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:08.250901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] validate_networks() for [('3f3ce0b9-727f-4320-a712-09bd6fad8f0f', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:03:08.265471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:08.278426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-235be617-e26f-423f-8df5-823177bee4dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.188489 Nov 22 23:03:08.280167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 311/638] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:08 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:08.285280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:08.286131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:08.295615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:08.296825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:08.297889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:08.298331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:08.550490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:08.558380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:08.559875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:08.561029 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8b890aa0-8c7b-4de4-8f80-9de32160225c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1744 microversion: 2.20 time: 0.279788 Nov 22 23:03:08.561584 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 312/639] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:08 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1744 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:08.682094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:03:08.682546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:03:08.683244 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:03:08.683659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:03:08.684075 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:03:08.693845 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:08.694547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:08.695370 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:08.695810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:08.713323 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Getting quotas for project 0f34c6ad90fb49c1a0d30a5701e0d0ef. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:03:08.717459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Getting quotas for user badb0895df7c4ef09a7ce7962d2d2f2a and project 0f34c6ad90fb49c1a0d30a5701e0d0ef. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:03:08.728853 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:03:08.731269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:03:08.778859 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-587067a4-a0bd-4905-81c4-0f386a276a47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591555 Nov 22 23:03:08.779683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 328/640] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:03:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 23:03:08.790537 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a58bc4e1-7b4b-4467-a8e5-2b3237762efe tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:08.791406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a58bc4e1-7b4b-4467-a8e5-2b3237762efe tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:08.860726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a58bc4e1-7b4b-4467-a8e5-2b3237762efe tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:08.868606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a58bc4e1-7b4b-4467-a8e5-2b3237762efe tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1219 microversion: 2.1 time: 0.082070 Nov 22 23:03:08.878767 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 313/641] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:08 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:09.298768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:09.299403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:09.305572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:09.306650 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:09.307780 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:09.308289 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:09.470965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:09.479460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-784d1d2d-9ec7-4037-b420-fca4a82058ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.185941 Nov 22 23:03:09.480054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 329/642] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:09 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:09.581265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:09.581883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:09.590214 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:09.590656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:09.591437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:09.592619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:09.767528 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:09.777219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:09.779032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:09.780203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ee4fbfa7-fab2-4845-ab93-712a564fc67c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1744 microversion: 2.20 time: 0.203729 Nov 22 23:03:09.780766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 314/643] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:09 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:09.885913 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:09.886619 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:09.893441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:09.894011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:09.894866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:09.895398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:09.962192 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:09.970142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6e1328d1-2a40-406b-a7e5-4c183bc0ee7c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1271 microversion: 2.1 time: 0.087682 Nov 22 23:03:09.970934 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 330/644] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:09 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:10.499084 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:10.500237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:10.506340 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:10.506997 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:10.507687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:10.509022 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:10.674490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:10.685579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9d03970d-9268-41e5-bbc2-62fd3779eaf2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.190678 Nov 22 23:03:10.686629 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 315/645] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:10 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:10.804011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:10.808369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:10.830956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:10.834523 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:10.836159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:10.836606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:11.002185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:11.002185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:11.011973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:11.017384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:11.018846 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:11.023735 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:11.023953 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:11.024443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:11.025874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:11.027218 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cafbf3a6-1383-4a0e-a482-8aabbade3f48 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1744 microversion: 2.20 time: 0.232042 Nov 22 23:03:11.028246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 331/646] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:10 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1744 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:11.176261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:11.184567 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cc10a7ba-c40b-42cf-bda0-b73a6a97f8fc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.199286 Nov 22 23:03:11.185202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 316/647] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:10 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:11.510380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2a2a1e24-ae15-4227-91a9-600f137da687 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Action: 'create', calling method: .version_select at 0x7fefc991ab80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-899634665", "metadata": {"Type": "work"}}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:11.588166 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-f1c5a48c-696f-4746-a0f7-391889e17472 req-839680cc-d5d2-42ff-a578-7a1c892d6828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e5b3870-e213-4dc5-89db-80e9b2061f69", "tag": "a614139d-ba4c-4365-b491-efd82443aa18"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:11.590141 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:03:11.590141 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:03:11.599587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f1c5a48c-696f-4746-a0f7-391889e17472 req-839680cc-d5d2-42ff-a578-7a1c892d6828 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:11.600605 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f1c5a48c-696f-4746-a0f7-391889e17472 req-839680cc-d5d2-42ff-a578-7a1c892d6828 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:11.612489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-f1c5a48c-696f-4746-a0f7-391889e17472 req-839680cc-d5d2-42ff-a578-7a1c892d6828 service nova] Creating event network-changed:a614139d-ba4c-4365-b491-efd82443aa18 for instance 6e5b3870-e213-4dc5-89db-80e9b2061f69 on hv-cinder-81883 Nov 22 23:03:11.617641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-f1c5a48c-696f-4746-a0f7-391889e17472 req-839680cc-d5d2-42ff-a578-7a1c892d6828 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032984 Nov 22 23:03:11.618317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 317/648] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:03:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:03:11.704135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:11.705350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:11.711926 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:11.712368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:11.713148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:11.714197 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:11.835041 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2a2a1e24-ae15-4227-91a9-600f137da687 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.463962 Nov 22 23:03:11.835666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 332/649] 10.222.0.81 () {60 vars in 1155 bytes} [Mon Nov 22 23:03:11 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 465 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 23:03:11.848670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3060e600-d86d-4a89-8864-db938bc8a594 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefc97a7160>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:11.883446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:11.892806 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b5ec4c84-5b97-4476-85f8-7d35f7ebe2ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.193288 Nov 22 23:03:11.893757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 318/650] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:11 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:11.903248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3060e600-d86d-4a89-8864-db938bc8a594 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 200 len: 352 microversion: 2.1 time: 0.058463 Nov 22 23:03:11.903837 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 333/651] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 23:03:11 2021] GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:03:12.046430 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:12.047452 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:12.053436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.053935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.054756 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.055175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.189016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:12.196912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:12.198464 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:12.199627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-95eb6b06-2358-4f40-9a23-47cab20943c8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1744 microversion: 2.20 time: 0.156991 Nov 22 23:03:12.200188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 319/652] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:12 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:12.201997 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:12.202620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:12.210993 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.211450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.212243 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.212960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.347160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:12.354441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-329c3110-a33c-4b87-91b7-f369aadeacf8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.156001 Nov 22 23:03:12.355009 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 334/653] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:12 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:12.675467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-f5d0e620-d5f6-4bca-b9c5-27f2c8b2b4d7 req-57d75bc7-6514-4505-9472-569c3aafbab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "name": "network-vif-plugged", "status": "completed", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:12.676978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:03:12.676978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:03:12.684563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f5d0e620-d5f6-4bca-b9c5-27f2c8b2b4d7 req-57d75bc7-6514-4505-9472-569c3aafbab7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.685014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f5d0e620-d5f6-4bca-b9c5-27f2c8b2b4d7 req-57d75bc7-6514-4505-9472-569c3aafbab7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.697512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-f5d0e620-d5f6-4bca-b9c5-27f2c8b2b4d7 req-57d75bc7-6514-4505-9472-569c3aafbab7 service nova] Creating event network-vif-plugged:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 23:03:12.702593 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-f5d0e620-d5f6-4bca-b9c5-27f2c8b2b4d7 req-57d75bc7-6514-4505-9472-569c3aafbab7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Nov 22 23:03:12.704041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 320/654] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:03:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:12.911208 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:12.911768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:12.918842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-da72907c-5529-4bc1-99c3-36bd5b907cae tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefcc6f4e50>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:12.924273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.924945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.926069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:12.926570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:12.972149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-da72907c-5529-4bc1-99c3-36bd5b907cae tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 200 len: 352 microversion: 2.1 time: 0.057104 Nov 22 23:03:12.972936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 321/655] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 23:03:12 2021] GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:13.073733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:13.082371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-16b23de5-df9e-4bd4-be26-83e33d63f24b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1724 microversion: 2.1 time: 0.174992 Nov 22 23:03:13.082942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 335/656] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:12 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:13.217734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:13.219094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:13.225220 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:13.225698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:13.226464 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:13.226894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:13.355160 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:13.363428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:13.365046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:13.366259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1473afca-454b-4fda-b2f3-97d465423d54 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1744 microversion: 2.20 time: 0.152339 Nov 22 23:03:13.366916 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 322/657] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:13 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:13.372124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:13.372742 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:13.379798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:13.380246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:13.381023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:13.381461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:13.513792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:13.521688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-21a32bf8-216f-4c60-9ae6-1e07a1cc2880 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.153538 Nov 22 23:03:13.522264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 336/658] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:13 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:13.984009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f500e164-531d-4211-87c2-e0e1ed6082de tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefca11e3a0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.029969 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f500e164-531d-4211-87c2-e0e1ed6082de tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 200 len: 353 microversion: 2.1 time: 0.049475 Nov 22 23:03:14.031699 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 323/659] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 23:03:13 2021] GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:14.043157 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1de3535a-8bec-48fe-a9cb-5e0b871cffc1 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefc9983310>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.093129 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1de3535a-8bec-48fe-a9cb-5e0b871cffc1 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 200 len: 353 microversion: 2.1 time: 0.054211 Nov 22 23:03:14.094731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 337/660] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 23:03:14 2021] GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:14.099877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.100830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:14.109171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.109753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.110670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.110785 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-09d45021-6613-4fc3-abc0-1e00e2f3437e tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefc981e550>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.111114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.174066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-09d45021-6613-4fc3-abc0-1e00e2f3437e tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 202 len: 0 microversion: 2.1 time: 0.067117 Nov 22 23:03:14.174708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 338/661] 10.222.0.81 () {58 vars in 1247 bytes} [Mon Nov 22 23:03:14 2021] DELETE /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:03:14.185522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4af54a3a-1470-4a4a-9afd-fccdba2e3be8 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefc993fa60>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.239258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4af54a3a-1470-4a4a-9afd-fccdba2e3be8 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 200 len: 352 microversion: 2.1 time: 0.057472 Nov 22 23:03:14.239990 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 339/662] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 23:03:14 2021] GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:14.252782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:14.260657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-065c7062-8d98-4310-9c8e-70d12a5b3aab tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1701 microversion: 2.1 time: 0.164870 Nov 22 23:03:14.261359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 324/663] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:14 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:14.277603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7890e4e1-f9ac-417c-8ac3-b61e319c7712 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:14.284725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7890e4e1-f9ac-417c-8ac3-b61e319c7712 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.285182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7890e4e1-f9ac-417c-8ac3-b61e319c7712 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.309586 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7890e4e1-f9ac-417c-8ac3-b61e319c7712 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Going to try to start instance {{(pid=116339) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 23:03:14.351917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7890e4e1-f9ac-417c-8ac3-b61e319c7712 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 202 len: 0 microversion: 2.1 time: 0.077618 Nov 22 23:03:14.352441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 340/664] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:03:14 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:03:14.360855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.361764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:14.369216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.369709 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.370611 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.371216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.385544 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.386356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:14.394811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.395696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.396930 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.397534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.830528 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:14.839103 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e016b0e2-24fc-487c-b0f9-c3bee0e383d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1710 microversion: 2.1 time: 0.482285 Nov 22 23:03:14.854369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 325/665] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:14 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1710 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:14.859218 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:14.859218 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:14.871283 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.871990 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.873000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:14.873437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:14.877510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:14.897496 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:14.903223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:14.904460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-556e8e26-813d-4b81-8122-01754fbc7936 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.523243 Nov 22 23:03:14.905031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 341/666] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:14 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:03:15.052148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:15.063614 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1ff720fc-4f46-4a0f-a75d-3c99de62fe60 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.207524 Nov 22 23:03:15.064501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 326/667] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:14 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:15.253571 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b33c3e31-6843-4670-9f4e-0d64d0851728 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Calling method '.version_select at 0x7fefc9a100d0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:15.287168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-b33c3e31-6843-4670-9f4e-0d64d0851728 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] HTTP exception thrown: Volume 8c59e77d-b234-434e-89c9-daded2eb78d3 could not be found. Nov 22 23:03:15.288433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b33c3e31-6843-4670-9f4e-0d64d0851728 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] Returning 404 to user: Volume 8c59e77d-b234-434e-89c9-daded2eb78d3 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:03:15.289535 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b33c3e31-6843-4670-9f4e-0d64d0851728 tempest-VolumesGetTestJSON-1286042563 tempest-VolumesGetTestJSON-1286042563-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3" status: 404 len: 109 microversion: 2.1 time: 0.041687 Nov 22 23:03:15.290799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 342/668] 10.222.0.81 () {58 vars in 1244 bytes} [Mon Nov 22 23:03:15 2021] GET /compute/v2.1/os-volumes/8c59e77d-b234-434e-89c9-daded2eb78d3 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:03:15.870602 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:15.888109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:15.905457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:15.910428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:15.912290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:15.914546 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:15.923101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:15.923760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:15.932223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:15.932994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:15.934128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:15.934772 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:16.225437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:16.246100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:16.247890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:16.249174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1b8a6158-4ae5-494f-81d4-c2adba0247cd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.329852 Nov 22 23:03:16.252813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 343/669] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:15 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:16.255144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:16.257855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:16.258471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:16.267434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:16.268154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:16.269310 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:16.270461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:16.300707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-384769f2-b6d1-43cc-95c4-5027ed56bd97 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1710 microversion: 2.1 time: 0.443619 Nov 22 23:03:16.305670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 327/670] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:15 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1710 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:16.498727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:16.509131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a0d01e04-25fe-424c-bcf4-e0bc5963b7dd tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.255046 Nov 22 23:03:16.510599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 344/671] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:16 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:17.268431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:17.269727 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:17.279733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:17.283236 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:17.284254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:17.284748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:17.327232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:17.330593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:17.341261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:17.346563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:17.347675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:17.348352 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:17.634119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:17.643441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:17.652647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:17.659870 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-78c316fd-3904-4179-806d-9839b80e9d93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1714 microversion: 2.1 time: 0.336940 Nov 22 23:03:17.662121 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:17.664634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 345/672] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:17 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1714 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:17.666619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e4337c84-b092-445e-bbc1-d95562a15459 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.402567 Nov 22 23:03:17.668165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 328/673] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:17 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:17.678151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:17.678821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:17.688547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:17.689041 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:17.689935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:17.690477 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:17.886276 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:17.897211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-93ed1834-f7aa-4a3d-8b98-0cb17935e708 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.231422 Nov 22 23:03:17.898087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 346/674] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:17 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:18.688634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:18.690123 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:18.698665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:18.699668 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:18.700704 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:18.701278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:18.889272 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:18.902957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:18.905224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:18.906828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2a2af9ce-4dd5-460c-b8bb-b0e26314aa3d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.223260 Nov 22 23:03:18.915274 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:18.915974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:18.918965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 329/675] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:18 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:18.924231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:18.925211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:18.926225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:18.926851 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:19.134039 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:19.143343 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4d0334b4-24fe-494a-8e2e-12cda74d12ba tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.232140 Nov 22 23:03:19.158415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 347/676] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:18 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:19.927420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:19.928632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:19.938667 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:19.939360 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:19.940154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:19.940584 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:20.104776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:20.119187 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:20.122132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:20.123383 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3dd0e0ab-26d6-4db5-b425-c6cf1ef97cd0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.201835 Nov 22 23:03:20.133978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 330/677] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:19 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:20.164754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:20.165361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:20.172517 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:20.173222 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:20.174217 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:20.174820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:20.349953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:20.359282 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-90275f73-8f9d-4ed2-91c1-e8222c77266a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.198319 Nov 22 23:03:20.369399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 348/678] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:20 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:20.778567 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-6b90d5e6-4a81-43a5-8f26-bb10e0596978 req-c8707d01-e0df-4d29-8d68-10331517e63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5b3870-e213-4dc5-89db-80e9b2061f69", "name": "network-vif-plugged", "status": "completed", "tag": "a614139d-ba4c-4365-b491-efd82443aa18"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:20.782061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:03:20.782061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:03:20.798986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-6b90d5e6-4a81-43a5-8f26-bb10e0596978 req-c8707d01-e0df-4d29-8d68-10331517e63b service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:20.799695 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-6b90d5e6-4a81-43a5-8f26-bb10e0596978 req-c8707d01-e0df-4d29-8d68-10331517e63b service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:20.817987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-6b90d5e6-4a81-43a5-8f26-bb10e0596978 req-c8707d01-e0df-4d29-8d68-10331517e63b service nova] Creating event network-vif-plugged:a614139d-ba4c-4365-b491-efd82443aa18 for instance 6e5b3870-e213-4dc5-89db-80e9b2061f69 on hv-cinder-81883 Nov 22 23:03:20.825223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-6b90d5e6-4a81-43a5-8f26-bb10e0596978 req-c8707d01-e0df-4d29-8d68-10331517e63b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050864 Nov 22 23:03:20.828034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 331/679] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:03:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:21.143925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:21.144945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:21.154033 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:21.154484 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:21.155272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:21.156318 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:21.318471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:21.328213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:21.330123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:21.331685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8fa6340b-f34f-44ce-acfe-207c5096fc70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.192366 Nov 22 23:03:21.332457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 349/680] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:21 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:21.378280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:21.379575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:21.387051 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:21.387715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:21.388518 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:21.388951 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:21.547708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:21.555769 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5fd2cfa4-4389-4c97-aa9e-1260f78e08ab tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.182525 Nov 22 23:03:21.565570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 332/681] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:21 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:22.352663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:22.353433 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:22.378072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:22.379607 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:22.382705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:22.383263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:22.573083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:22.573859 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:22.582539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:22.591516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:22.604580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:22.606125 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:22.607299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2f9f856a-fbb3-4180-ac1f-2beb0bcd6b24 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.259346 Nov 22 23:03:22.610402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:22.613512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:22.614117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:22.619233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 350/682] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:22 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:22.786753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:22.794878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4686a43d-05c1-410e-8d5a-555c15e99e6f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1319 microversion: 2.1 time: 0.225492 Nov 22 23:03:22.795455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 333/683] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:22 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:03:23.637348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:23.638678 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:23.645281 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:23.646640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:23.647679 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:23.648486 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:23.818901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:23.818901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:23.820831 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:23.821568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:23.836260 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:23.836986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:23.837523 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:23.855154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:23.857071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:23.858527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a361de23-276f-480f-b035-b1e77889918e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.225990 Nov 22 23:03:23.871545 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 351/684] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:23 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:24.062141 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:24.071153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f9b5cb54-14be-4d72-85ac-3e0d3fa107a8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1507 microversion: 2.1 time: 0.262193 Nov 22 23:03:24.071729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 334/685] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:03:23 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:03:24.877601 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:24.878260 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:24.885102 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:24.885550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:24.886354 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:24.886784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:25.028633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:25.039206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:25.040939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:25.042320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6df95b93-abba-40f9-af21-144ce1cec7b8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1739 microversion: 2.20 time: 0.168645 Nov 22 23:03:25.054381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 352/686] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:24 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:26.062593 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:26.063249 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:26.069660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:26.070118 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:26.070898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:26.071337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:26.208182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:26.215957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:26.217460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:26.219136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-44607765-a99c-44db-aab0-27b620c246f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.160817 Nov 22 23:03:26.219698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 335/687] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:26 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:27.238637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:27.239362 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:27.245665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:27.246118 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:27.246889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:27.247322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:27.386417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:27.394916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:27.396405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:27.397542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1a7fcc13-b849-4630-9c60-00ae4550d622 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.162544 Nov 22 23:03:27.398146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 353/688] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:27 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:28.416379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:28.416978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:28.424216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:28.424655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:28.425423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:28.425883 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:28.556320 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:28.564294 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:28.565805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:28.566936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bd2d4a0f-77b9-4910-b196-8cf73ffc815e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.154467 Nov 22 23:03:28.567490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 336/689] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:28 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:29.584889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:29.585480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:29.591863 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:29.592316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:29.593368 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:29.593925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:29.727649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:29.736101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:29.737563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:29.738718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bcd5f4e2-cb36-492d-a793-35e66b2e5c29 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.157601 Nov 22 23:03:29.739294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 354/690] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:29 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:30.756843 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:30.757446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:30.763931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:30.764374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:30.765280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:30.765701 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:30.903661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:30.912040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:30.913897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:30.915072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fea6abd3-bb91-40cd-a0ec-d4a24afeda21 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.161893 Nov 22 23:03:30.915648 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 337/691] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:30 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:31.934362 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:31.935408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:31.941862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:31.942394 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:31.943304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:31.943790 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:32.010374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-94b61d32-c65b-4c4a-b07a-f3612e02e944 req-b94214fc-16af-4778-9ebe-b532481156c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "name": "network-vif-unplugged", "status": "completed", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:32.012809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:03:32.012809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:03:32.025338 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-94b61d32-c65b-4c4a-b07a-f3612e02e944 req-b94214fc-16af-4778-9ebe-b532481156c7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:32.028023 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-94b61d32-c65b-4c4a-b07a-f3612e02e944 req-b94214fc-16af-4778-9ebe-b532481156c7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:32.042335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-94b61d32-c65b-4c4a-b07a-f3612e02e944 req-b94214fc-16af-4778-9ebe-b532481156c7 service nova] Creating event network-vif-unplugged:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 23:03:32.049101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-94b61d32-c65b-4c4a-b07a-f3612e02e944 req-b94214fc-16af-4778-9ebe-b532481156c7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042980 Nov 22 23:03:32.050056 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 338/692] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:03:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:03:32.097175 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:32.105090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:32.106618 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:32.107767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b5a1bf6e-aeca-4d8e-84eb-147be008184c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.178093 Nov 22 23:03:32.109820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 355/693] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:31 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:33.127770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:33.128376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:33.134965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:33.135409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:33.136178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:33.136616 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:33.274934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:33.283882 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:33.285371 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:33.286548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-12edc6c9-3d8a-46b0-933a-1a76cf37e548 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.163065 Nov 22 23:03:33.287101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 339/694] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:33 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:34.304665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:34.305317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:34.316160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:34.316968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:34.318425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:34.319233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:34.450707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:34.459228 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:34.460752 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:34.461964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a6ada08f-1c5f-4a03-9ed2-56b69367dbff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.161011 Nov 22 23:03:34.462527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 356/695] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:34 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:35.480034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:35.480649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:35.487237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:35.487691 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:35.488473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:35.488915 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:35.626341 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:35.634331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:35.635804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:35.636940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e7ce0dac-f58c-4d12-87ff-a0490a1d3d6f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.160608 Nov 22 23:03:35.637482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 340/696] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:35 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:36.655616 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:36.656277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:36.662843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:36.663291 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:36.664060 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:36.664485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:36.793928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:36.801986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:36.803478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:36.804624 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8d1d4d81-026b-4821-a7c2-8aff235a1565 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.152931 Nov 22 23:03:36.805186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 357/697] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:36 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:37.823486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:37.824096 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:37.831134 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:37.831588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:37.832373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:37.832811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:37.966048 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:37.974322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:37.975821 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:37.976961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-45f14c64-7ce5-49b8-93a6-72d43371b6d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.157695 Nov 22 23:03:37.977517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 341/698] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:37 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:38.995677 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:38.996192 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:39.003680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:39.004134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:39.004931 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:39.005371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:39.142463 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:39.150590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:39.152077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:39.153217 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-af8548dc-b23a-4cf6-9d7e-a6a8785cd4b5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.161442 Nov 22 23:03:39.153845 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 358/699] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:38 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:40.171922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:40.172646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:40.179616 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:40.180062 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:40.181001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:40.181313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:40.318049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:40.325642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:40.327902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:40.329024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-542861b2-146c-4ad5-af50-143cb23a3c89 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1721 microversion: 2.20 time: 0.161137 Nov 22 23:03:40.329577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 342/700] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:40 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:41.347719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:41.348249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:41.354521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:41.354977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:41.355761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:41.356189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:41.504624 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:41.514890 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:41.516386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:41.517553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a566def0-d793-4254-83ed-726981b74a5f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1724 microversion: 2.20 time: 0.173739 Nov 22 23:03:41.518211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 359/701] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:41 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:41.536359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "883aa653-e216-406d-bc09-c92dea3acfe7"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:41.537983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:41.545170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:41.545697 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:41.547075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:41.547660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:41.846099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-739522a8-ae83-4db5-8355-334969c9b583 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313732 Nov 22 23:03:41.847045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 343/702] 10.222.0.81 () {62 vars in 1363 bytes} [Mon Nov 22 23:03:41 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:03:41.957683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:03:41.958247 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:41.963955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:41.964404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:41.965177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:41.965632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:42.055603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d303c363-5595-450e-af0f-a2a8f7a30761 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action" status: 202 len: 0 microversion: 2.20 time: 0.101537 Nov 22 23:03:42.056206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 360/703] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:03:41 2021] POST /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 22 23:03:42.064765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:42.065758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:42.073552 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:42.074159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:42.075336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:42.075990 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:42.213066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:42.223158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:42.224875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:42.226541 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-40992a88-b9a5-4c26-8eb1-45ab4529885e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1750 microversion: 2.20 time: 0.166063 Nov 22 23:03:42.227133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 344/704] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:42 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:43.247393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:43.248003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:43.254488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:43.254936 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:43.255742 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:43.256486 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:43.387647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:43.396246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:43.397760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:43.398907 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-387ebb3b-8daa-436a-90df-76d04c05cb14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1752 microversion: 2.20 time: 0.155674 Nov 22 23:03:43.399456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 361/705] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:43 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:44.418564 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:44.419337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:44.426651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:44.427113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:44.428726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:44.429522 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:44.565535 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:44.575072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:44.577087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:44.578531 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b3f7b2d6-72ab-482b-a226-0df8027a1c45 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.163944 Nov 22 23:03:44.579091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 345/706] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:44 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:45.597759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:45.598373 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:45.609262 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:45.609747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:45.610547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:45.610983 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:45.790948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:45.800499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:45.802127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:45.803360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-043a4258-2078-406f-bbe6-49ee5b5bc1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.210887 Nov 22 23:03:45.814623 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 362/707] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:45 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:46.821047 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:46.822394 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:46.829764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:46.830637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:46.831510 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:46.832020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:46.967059 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:46.975567 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:46.977065 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:46.978239 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-025d656b-1bfc-47c9-9dcf-d97aaf16a569 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.160796 Nov 22 23:03:46.978803 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 346/708] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:46 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:47.996730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:47.997330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:48.004128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:48.004578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:48.005395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:48.005858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:48.142015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:48.150304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:48.151798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:48.152940 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-20061833-3094-40dc-aa08-a57c2a5d6cdc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.159921 Nov 22 23:03:48.153497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 363/709] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:47 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:49.172457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:49.173099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:49.180087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:49.180591 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:49.181340 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:49.181926 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:49.327374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:49.335961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:49.337457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:49.338657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5c534183-6125-4361-803f-d8645ab1d5a0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.170446 Nov 22 23:03:49.339222 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 347/710] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:49 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:50.355947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:50.356666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:50.363692 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:50.364134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:50.364904 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:50.365335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:50.554140 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:50.562996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:50.564465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:50.565596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9ddc42b1-815f-40f3-ae72-3f53c3859e0f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.213336 Nov 22 23:03:50.566187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 364/711] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:50 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:51.584136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:51.584775 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:51.590889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:51.591344 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:51.592175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:51.592812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:51.782873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:51.791837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:51.793322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:51.794606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-643f5ba7-e912-4715-9e85-932862acffa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.214220 Nov 22 23:03:51.796326 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 348/712] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:51 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:52.812387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:52.813025 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:52.819804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:52.821997 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:52.823159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:52.823673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:52.986206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:52.995229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:52.996720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:52.997899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-71da037f-2cd9-430c-b84e-34198677b953 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.189514 Nov 22 23:03:53.008797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 365/713] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:52 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:54.016481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:54.017037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:54.023454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:54.023907 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:54.024683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:54.025156 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:54.156660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:54.165574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:54.167145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:54.168372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-53186a0c-6f0a-4c8b-af97-4f961c28d97a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.155897 Nov 22 23:03:54.168974 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 349/714] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:54 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:55.187175 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:55.187779 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:55.194181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:55.194630 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:55.195405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:55.195841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:55.333145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:55.341369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:55.343174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:55.344319 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9c083fea-37ce-4667-908e-37b448440561 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.160842 Nov 22 23:03:55.344877 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 366/715] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:55 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:03:56.362309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:56.362921 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:56.369242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:56.369727 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:56.370700 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:56.371186 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:56.510041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:56.519185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:56.520683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:56.521877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-87615fea-755d-4bbc-a37c-9970a82cc6b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.163239 Nov 22 23:03:56.522431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 350/716] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:56 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:03:57.557513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:57.558261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:57.565955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:57.566810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:57.567842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:57.568501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:57.707694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:57.716124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:57.717757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:57.718901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-986c3414-6aac-4aa7-866d-c6253d52cff6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.176261 Nov 22 23:03:57.719490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 367/717] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:57 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:03:58.736330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:03:58.736973 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:03:58.743569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:58.744099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:58.744983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:03:58.745491 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:03:58.907486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:58.916215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:58.917721 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:03:58.918863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fc25b284-873e-4d1f-997b-7384b2e4744e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.186396 Nov 22 23:03:58.919406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 351/718] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:58 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:00.136224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:00.137565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:00.144863 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:00.145309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:00.146298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:00.146736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:00.380620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:00.403416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:00.407959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:00.409688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c1c1d7c2-74fe-4152-84de-d35969525dc9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.476003 Nov 22 23:04:00.410266 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 368/719] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:03:59 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:00.801562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:04:00.801976 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:04:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:04:01.434191 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:01.436246 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:01.444786 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:01.445434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:01.446385 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:01.447139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:01.595476 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:01.604814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:01.606540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:01.608501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4c9ef85b-c68a-44aa-bf93-9e29500e8d47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.181906 Nov 22 23:04:01.609066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 352/720] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:01 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:02.627931 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:02.628531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:02.635144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:02.635590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:02.636566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:02.637003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:02.770870 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:02.779671 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:02.781151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:02.782329 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2854075f-0b26-4c7e-a3df-faca672acacd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.159007 Nov 22 23:04:02.782865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 369/721] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:02 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:03.401161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e04c36af-a7a4-4cfe-b9bf-17b7d97811e3", "device": "/dev/sdb"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:04:03.402822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:03.409389 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:03.409878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:03.410655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:03.411093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:03.800506 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:03.801124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:03.807408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:03.807861 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:03.808645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:03.809087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:03.956915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:03.965355 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:03.967242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:03.968425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-94320074-07b0-42be-ab1f-44886f65797a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.171546 Nov 22 23:04:03.968972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 370/722] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:03 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:04.986724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:04.987402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:04.994272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:04.994990 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:04.996019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:04.996470 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:05.040366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5f77432c-c573-48c5-ab31-3fb5c02d475d tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "POST /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.642538 Nov 22 23:04:05.042300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 353/723] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:04:03 2021] POST /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69/os-volume_attachments => generated 194 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:04:05.146636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:05.156147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:05.157889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:05.159077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-582e7bfc-255f-474d-9460-eb3ebd1cb3fa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.176613 Nov 22 23:04:05.159901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 371/724] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:04 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:06.179184 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:06.179873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:06.187124 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:06.187576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:06.188353 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:06.188789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:06.337149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:06.346417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:06.348000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:06.349164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-13a5841d-1f33-4ba0-8a47-0652b799dd8d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.175154 Nov 22 23:04:06.353919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 354/725] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:06 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:07.367195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:07.368209 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:07.374863 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:07.375363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:07.376494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:07.377165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:07.528756 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:07.537834 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:07.539430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:07.540585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fc75e2b4-2cf7-42a5-ab51-165dd012fef3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.177020 Nov 22 23:04:07.541137 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 372/726] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:07 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:08.559411 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:08.560114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:08.567744 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:08.568269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:08.569083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:08.569559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:08.705588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:08.713750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:08.715240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:08.716377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d6186397-7517-41bd-a6ff-bc9bd8201111 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.161043 Nov 22 23:04:08.716988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 355/727] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:08 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:09.734924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:09.735720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:09.743199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:09.743650 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:09.744446 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:09.744887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:09.877408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:09.885575 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:09.887086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:09.888369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b6626366-6a2b-4f11-a828-f204fe5a32d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.157443 Nov 22 23:04:09.889485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 373/728] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:09 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:10.907492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:10.908102 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:10.915055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:10.915510 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:10.916315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:10.916760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:11.067311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:11.076760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:11.078290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:11.079437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-61a31c71-6d29-4dca-911f-98ace174a3fb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.175983 Nov 22 23:04:11.079996 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 356/729] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:10 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:12.098793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:12.099798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:12.106004 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:12.106459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:12.108286 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:12.108724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:12.262651 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:12.273113 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:12.275435 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:12.276833 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a6f18233-5a76-4479-a0dd-c8e48b18353c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.181826 Nov 22 23:04:12.277461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 374/730] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:12 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:13.298466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:13.299074 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:13.305368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:13.305857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:13.306638 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:13.307075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:13.450514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:13.459091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:13.460588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:13.461772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a7096bf3-2cc7-4430-9124-baba12457fa9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.167794 Nov 22 23:04:13.462338 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 357/731] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:13 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:14.480640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:14.481365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:14.488268 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:14.488723 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:14.489498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:14.489971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:14.625918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:14.634216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:14.635709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:14.636878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4830b451-6fee-4d1c-8f39-b04bb7f19f0d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.159936 Nov 22 23:04:14.637440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 375/732] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:14 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:04:15.655520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:15.656046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:15.662641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:15.663082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:15.663854 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:15.664286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:15.797414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:15.805494 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:15.806998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:15.808135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0662002a-5a5f-4258-b97d-5f6110ac2cf8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.156593 Nov 22 23:04:15.808682 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 358/733] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:15 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:04:16.826889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:16.827485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:16.833954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:16.834438 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:16.835179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:16.835621 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:16.971642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:16.980226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:16.981808 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:16.982962 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5d7156f2-ed60-4c87-8b41-b1a404cad8d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.160255 Nov 22 23:04:16.983513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 376/734] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:16 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:04:18.001854 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:18.002392 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:18.008776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:18.009227 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:18.010040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:18.010486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:18.142390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:18.150636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:18.152147 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:18.153363 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-69fb8efc-7ee9-44ea-bc9f-c9248f8dc2ab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.155603 Nov 22 23:04:18.154771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 359/735] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:17 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:19.173793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:19.174348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:19.180206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:19.180673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:19.181434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:19.181891 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:19.314847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:19.323058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:19.324546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:19.325889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-48bd237a-1816-4912-bcbf-4b39a55ab453 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.156609 Nov 22 23:04:19.326718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 377/736] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:19 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:20.344105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:20.344715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:20.351009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:20.351465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:20.352244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:20.352682 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:20.487076 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:20.495112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:20.496574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:20.498436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e6ce5300-2957-4a3a-90ef-5be64d525bac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.157357 Nov 22 23:04:20.499103 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 360/737] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:20 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:21.517427 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:21.518084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:21.524509 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:21.524957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:21.525768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:21.526206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:21.663355 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:21.673168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:21.674670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:21.675843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-db012fc8-3396-4064-9cbb-b5096dbc24c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.162902 Nov 22 23:04:21.676407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 378/738] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:21 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:04:22.694001 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:22.694741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:22.700948 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:22.701398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:22.702209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:22.702646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:22.836174 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:22.845206 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:22.846755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:22.848046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d479787f-7912-43af-a365-87dec8276c7e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.157769 Nov 22 23:04:22.848608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 361/739] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:22 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:23.866490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:23.867100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:23.873578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:23.874058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:23.874838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:23.875273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:24.014942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:24.023599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:24.025070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:24.026243 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ee712e7d-5967-4852-8257-a32108aec632 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.163511 Nov 22 23:04:24.026793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 379/740] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:23 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:25.046201 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:25.046819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:25.053128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:25.053579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:25.054395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:25.054834 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:25.189106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:25.197407 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:25.198956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:25.200104 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-228569c9-63f2-4ae5-8287-627dc7d891e0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.158484 Nov 22 23:04:25.200685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 362/741] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:25 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:26.218309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:26.218916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:26.225195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:26.225670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:26.226442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:26.226873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:26.358511 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:26.366785 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:26.368267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:26.369402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-142dedb1-329d-4ec7-b6c8-55c748b28c79 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.155038 Nov 22 23:04:26.369996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 380/742] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:26 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:27.388493 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:27.389113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:27.395579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:27.396032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:27.396844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:27.397281 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:27.534847 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:27.543256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:27.545662 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:27.546813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b2565c56-b2e0-4f54-9115-a61de7abb181 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.162518 Nov 22 23:04:27.547375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 363/743] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:27 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:28.564239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:28.564836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:28.571207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:28.571652 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:28.572444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:28.572874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:28.703285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:28.711571 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:28.713089 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:28.714264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-88c58599-2b96-47b4-9ee0-6d1331c2e6d4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.153583 Nov 22 23:04:28.714823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 381/744] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:28 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:28.969563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-8051c217-76cc-4c88-9820-11e03abdc475 req-43419bbb-a23b-43da-a91b-bdb59f6edeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "name": "network-vif-plugged", "status": "completed", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:04:28.971772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:04:28.971772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:04:28.980264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-8051c217-76cc-4c88-9820-11e03abdc475 req-43419bbb-a23b-43da-a91b-bdb59f6edeb8 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:28.980703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-8051c217-76cc-4c88-9820-11e03abdc475 req-43419bbb-a23b-43da-a91b-bdb59f6edeb8 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:28.996615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-8051c217-76cc-4c88-9820-11e03abdc475 req-43419bbb-a23b-43da-a91b-bdb59f6edeb8 service nova] Creating event network-vif-plugged:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 23:04:29.002426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-8051c217-76cc-4c88-9820-11e03abdc475 req-43419bbb-a23b-43da-a91b-bdb59f6edeb8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038137 Nov 22 23:04:29.003191 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 364/745] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:04:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:04:29.734525 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:29.735146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:29.741749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:29.742204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:29.743004 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:29.743442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:29.898519 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:29.912917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:29.914977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:29.916548 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3fa0a67d-7d19-48da-8e20-f6147d684342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.187753 Nov 22 23:04:29.917298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 382/746] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:29 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:30.936634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:30.937358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:30.943869 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:30.944319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:30.945098 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:30.945530 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:31.079776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:31.088143 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:31.089676 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:31.091971 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-12fb5a6e-c99d-4941-b662-b22b1513b559 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.159225 Nov 22 23:04:31.092616 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 365/747] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:30 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:32.110148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:32.110723 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:32.116992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:32.117442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:32.118249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:32.118689 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:32.251951 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:32.260254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:32.261769 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:32.263504 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-66a28f85-a975-4018-aaeb-b10f2aea0460 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.157390 Nov 22 23:04:32.264056 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 383/748] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:32 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:33.281028 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:33.281632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:33.288357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:33.288801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:33.289577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:33.290032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:33.422920 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:33.431054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:33.432547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:33.433994 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d56bf6ac-4519-4d4e-b58e-030dc1e586d6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.156767 Nov 22 23:04:33.434698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 366/749] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:33 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:34.453810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:34.454378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:34.460720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:34.461167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:34.461965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:34.462398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:34.592866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:34.601491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:34.603158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:34.604370 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-06898431-1cfe-431d-a773-26e7d7fe0dab tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.154884 Nov 22 23:04:34.604978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 384/750] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:34 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:35.624430 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:35.625042 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:35.631356 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:35.631805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:35.632589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:35.633035 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:35.767481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:35.775761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:35.777245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:35.778439 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bc8fb2b1-8d3b-4374-9a5f-ab5a5e96134b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.158498 Nov 22 23:04:35.779000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 367/751] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:35 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:36.797972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:36.798567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:36.805099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:36.805545 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:36.806353 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:36.806791 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:36.939018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:36.947792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:36.949272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:36.950957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-11b64f6b-3f9f-4b96-9121-6f55bbf19a05 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.157435 Nov 22 23:04:36.951542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 385/752] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:36 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:37.968203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:37.968759 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:37.974847 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:37.975286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:37.976049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:37.976480 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:38.104550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:38.113219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:38.114720 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:38.115889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a72d3335-4e80-4a92-80a2-a4e9a734a45c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.151550 Nov 22 23:04:38.116442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 368/753] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:37 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:39.134550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:39.135139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:39.142012 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:39.142555 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:39.143473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:39.143937 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:39.280849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:39.296048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:39.297545 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:39.298741 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-953a030f-3501-43ed-a471-9fb5c4dbf76e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.167848 Nov 22 23:04:39.299312 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 386/754] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:39 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:40.318207 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:40.319719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:40.326779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:40.327230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:40.328037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:40.328526 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:40.461312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:40.470651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:40.472137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:40.473540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-63c80f1a-5041-498d-8bad-b3bf0852199c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1808 microversion: 2.20 time: 0.159562 Nov 22 23:04:40.474131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 369/755] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:40 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:04:41.492383 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:41.492972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:41.499536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:41.499975 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:41.500754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:41.501198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:41.660788 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:41.671206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:41.672873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:41.674182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-941721ab-690d-4d86-b4cb-f29b3d2c2735 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1795 microversion: 2.20 time: 0.185474 Nov 22 23:04:41.674787 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 387/756] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:04:41 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1795 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:04:42.987640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:42.988159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:42.994545 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:42.994995 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:42.995805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:42.996235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:43.076764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lazy-loading 'services' on Instance uuid 6e5b3870-e213-4dc5-89db-80e9b2061f69 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:04:43.150148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3c6fd4cc-8e91-4324-935e-52e6edf8b1e1 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69/os-volume_attachments/e04c36af-a7a4-4cfe-b9bf-17b7d97811e3" status: 202 len: 0 microversion: 2.1 time: 0.165908 Nov 22 23:04:43.150760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 370/757] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:04:42 2021] DELETE /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69/os-volume_attachments/e04c36af-a7a4-4cfe-b9bf-17b7d97811e3 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:04:45.311877 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:45.312431 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:45.318652 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:45.319098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:45.319868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:45.320303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:45.344837 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:04:45.421830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b387dd0d-3a6d-4fb0-a07b-1e49f4ac0120 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 204 len: 0 microversion: 2.1 time: 0.113047 Nov 22 23:04:45.422538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 388/758] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:04:45 2021] DELETE /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:04:45.431441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:45.432146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:45.438405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:45.438854 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:45.439630 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:45.440064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:45.586061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:45.594508 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-dfa17f61-e539-439f-843e-e65cd6220d47 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1513 microversion: 2.1 time: 0.167568 Nov 22 23:04:45.595085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 371/759] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:45 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:04:46.611687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:46.612381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:46.618761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:46.619210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:46.619991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:46.620434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:46.756200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:46.764253 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-48a1c569-d76c-41e8-a7d9-903d7b6b2709 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1513 microversion: 2.1 time: 0.156638 Nov 22 23:04:46.764820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 389/760] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:46 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:04:47.781036 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:47.781660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:47.788224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:47.788675 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:47.789458 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:47.789939 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:47.927885 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:47.935932 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e97fdcd6-a5a2-4866-a297-48f682981154 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1513 microversion: 2.1 time: 0.158528 Nov 22 23:04:47.936505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 372/761] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:47 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:04:48.953108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:48.953746 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:48.959836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:48.960291 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:48.961071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:48.961504 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:49.091854 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:49.099264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dd705154-766d-452a-a945-fdc0ac2c2d75 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1513 microversion: 2.1 time: 0.150638 Nov 22 23:04:49.099905 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 390/762] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:48 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:04:50.116157 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:50.116762 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:50.123769 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:50.124216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:50.125044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:50.125486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:50.262615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:50.270094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5aa0b441-2047-4f52-bf4b-a8b5563711c4 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1513 microversion: 2.1 time: 0.157544 Nov 22 23:04:50.270664 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 373/763] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:50 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:04:51.288062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:51.288667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:51.295595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:51.296053 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:51.296836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:51.297270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:51.437180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:51.446091 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fb0cb01a-650e-4081-9d1b-7ae988b3716c tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1513 microversion: 2.1 time: 0.162153 Nov 22 23:04:51.446675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 391/764] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:51 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:04:52.217343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-7793df1a-d8b0-404c-aa36-a8507d7a67af req-cdfdf016-92eb-4492-aac4-0870d0efc4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e5b3870-e213-4dc5-89db-80e9b2061f69", "name": "network-vif-deleted", "tag": "a614139d-ba4c-4365-b491-efd82443aa18"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:04:52.224960 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:04:52.224960 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:04:52.236640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-7793df1a-d8b0-404c-aa36-a8507d7a67af req-cdfdf016-92eb-4492-aac4-0870d0efc4f7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:52.237089 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-7793df1a-d8b0-404c-aa36-a8507d7a67af req-cdfdf016-92eb-4492-aac4-0870d0efc4f7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:52.251195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-7793df1a-d8b0-404c-aa36-a8507d7a67af req-cdfdf016-92eb-4492-aac4-0870d0efc4f7 service nova] Creating event network-vif-deleted:a614139d-ba4c-4365-b491-efd82443aa18 for instance 6e5b3870-e213-4dc5-89db-80e9b2061f69 on hv-cinder-81883 Nov 22 23:04:52.256390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-7793df1a-d8b0-404c-aa36-a8507d7a67af req-cdfdf016-92eb-4492-aac4-0870d0efc4f7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171278 Nov 22 23:04:52.257015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 374/765] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:04:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:04:52.464146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:52.464747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:52.471964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:52.472417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:52.473209 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:52.473680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:52.505296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:52.505690 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:52.506143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lazy-loading 'fault' on Instance uuid 6e5b3870-e213-4dc5-89db-80e9b2061f69 {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:04:52.545990 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:04:52.553513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d1b776d8-9cc6-45f0-85ca-f490508eae03 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 200 len: 1309 microversion: 2.1 time: 0.092952 Nov 22 23:04:52.554123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 392/766] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:52 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:04:53.572263 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:04:53.572999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 6e5b3870-e213-4dc5-89db-80e9b2061f69] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:04:53.579690 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:53.580145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:53.580939 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:04:53.581380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:04:53.595834 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] HTTP exception thrown: Instance 6e5b3870-e213-4dc5-89db-80e9b2061f69 could not be found. Nov 22 23:04:53.596397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Returning 404 to user: Instance 6e5b3870-e213-4dc5-89db-80e9b2061f69 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:04:53.597342 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c41d704d-4586-4a8e-8d8d-51ab2701ff2e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69" status: 404 len: 111 microversion: 2.1 time: 0.030088 Nov 22 23:04:53.598084 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 375/767] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:04:53 2021] GET /compute/v2.1/servers/6e5b3870-e213-4dc5-89db-80e9b2061f69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:05:08.625035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1806884706", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "3f3ce0b9-727f-4320-a712-09bd6fad8f0f"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:08.677688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] validate_networks() for [('3f3ce0b9-727f-4320-a712-09bd6fad8f0f', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:05:09.062062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:05:09.062489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:05:09.062971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:05:09.063446 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:05:09.063857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:05:09.073034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:09.073517 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:09.074513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:09.076090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:09.091684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Getting quotas for project 0f34c6ad90fb49c1a0d30a5701e0d0ef. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:05:09.095582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Getting quotas for user badb0895df7c4ef09a7ce7962d2d2f2a and project 0f34c6ad90fb49c1a0d30a5701e0d0ef. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:05:09.106752 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:05:09.109068 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:05:09.152387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4053df2f-8f38-4e52-a4d1-2c8f367f2ea3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531721 Nov 22 23:05:09.153395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 393/768] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:05:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:05:09.163216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ea776d57-2503-436f-9303-fb9611dddabb tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:09.163941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ea776d57-2503-436f-9303-fb9611dddabb tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:09.220178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ea776d57-2503-436f-9303-fb9611dddabb tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:09.227019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ea776d57-2503-436f-9303-fb9611dddabb tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1219 microversion: 2.1 time: 0.067476 Nov 22 23:05:09.227684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 376/769] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:09 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:10.244551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:10.245174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:10.251897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:10.252340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:10.253111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:10.253541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:10.515767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:10.523051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ec9ac056-6661-4c24-b484-e7b9fb01804a tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1223 microversion: 2.1 time: 0.282701 Nov 22 23:05:10.523613 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 394/770] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:10 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1223 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:11.540524 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:11.541122 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:11.548625 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:11.549079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:11.550031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:11.550460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:11.608127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:11.615223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f8f47b4e-71aa-4281-a4ae-b0e84c06c376 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1223 microversion: 2.1 time: 0.078860 Nov 22 23:05:11.615776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 377/771] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:11 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:12.632149 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:12.632787 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:12.639732 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:12.640174 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:12.640936 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:12.641364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:12.700160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:12.707436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-09e9ab3f-c6de-43e1-9608-6bf8be10130f tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1271 microversion: 2.1 time: 0.078966 Nov 22 23:05:12.707995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 395/772] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:12 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:13.724545 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:13.725151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:13.733528 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:13.734343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:13.735140 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:13.735574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:13.875533 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:13.883757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-470c9270-e1e9-46ce-9850-c267d12decbc tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.162868 Nov 22 23:05:13.884404 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 378/773] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:13 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:14.499313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-a395be1e-38f5-4178-be61-8ce8f18f35df req-19baa57f-3f5e-44ad-9e68-7d255c892485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954e5e50-a667-4ea8-add1-2da77ef4b3a1", "tag": "3f5004c5-7e65-459b-b915-ffeaedf74541"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:14.500889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:05:14.500889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:05:14.510784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a395be1e-38f5-4178-be61-8ce8f18f35df req-19baa57f-3f5e-44ad-9e68-7d255c892485 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:14.511547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a395be1e-38f5-4178-be61-8ce8f18f35df req-19baa57f-3f5e-44ad-9e68-7d255c892485 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:14.523192 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-a395be1e-38f5-4178-be61-8ce8f18f35df req-19baa57f-3f5e-44ad-9e68-7d255c892485 service nova] Creating event network-changed:3f5004c5-7e65-459b-b915-ffeaedf74541 for instance 954e5e50-a667-4ea8-add1-2da77ef4b3a1 on hv-cinder-81883 Nov 22 23:05:14.528509 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-a395be1e-38f5-4178-be61-8ce8f18f35df req-19baa57f-3f5e-44ad-9e68-7d255c892485 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032957 Nov 22 23:05:14.529088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 396/774] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:05:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:05:14.901274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:14.902064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:14.909287 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:14.909775 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:14.910563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:14.911267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:15.059093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:15.066588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-58f5e708-6c19-48b9-8b02-ed290075a961 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.168947 Nov 22 23:05:15.067161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 379/775] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:14 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:16.084829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:16.085537 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:16.092582 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:16.093032 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:16.093850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:16.094294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:16.227975 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:16.236377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f03cdb85-ee42-4e29-a7ab-0219291a93e5 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.156039 Nov 22 23:05:16.236948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 397/776] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:16 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:17.253031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:17.253609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:17.259937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:17.260391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:17.261222 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:17.261686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:17.395510 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:17.404414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-272bbd77-b37a-447d-b8a3-aaf5cce76288 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.155458 Nov 22 23:05:17.404980 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 380/777] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:17 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:18.421821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:18.422416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:18.428322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:18.428769 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:18.429532 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:18.429990 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:18.563389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:18.570592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-95c38678-8897-4954-ba9c-918fd3a0b731 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.152676 Nov 22 23:05:18.571156 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 398/778] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:18 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:19.588056 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:19.588793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:19.595858 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:19.596385 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:19.597257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:19.597807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:19.740450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:19.748309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-63bc022e-7e58-4395-a269-5c6d290a9d18 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.163826 Nov 22 23:05:19.748891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 381/779] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:19 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:20.765606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:20.766241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:20.772563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:20.773011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:20.773844 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:20.774288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:20.911070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:20.918977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e3b96251-6403-4396-9dc9-eb64f717ea9e tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.157739 Nov 22 23:05:20.919525 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 399/780] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:20 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:21.069014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-3c45050f-abc8-49cd-939b-bdaab1017dab req-f8bde898-fd82-4d84-908f-eed0659fad6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954e5e50-a667-4ea8-add1-2da77ef4b3a1", "name": "network-vif-plugged", "status": "completed", "tag": "3f5004c5-7e65-459b-b915-ffeaedf74541"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:21.070571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:05:21.070571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:05:21.077869 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3c45050f-abc8-49cd-939b-bdaab1017dab req-f8bde898-fd82-4d84-908f-eed0659fad6d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:21.078312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3c45050f-abc8-49cd-939b-bdaab1017dab req-f8bde898-fd82-4d84-908f-eed0659fad6d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:21.091110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-3c45050f-abc8-49cd-939b-bdaab1017dab req-f8bde898-fd82-4d84-908f-eed0659fad6d service nova] Creating event network-vif-plugged:3f5004c5-7e65-459b-b915-ffeaedf74541 for instance 954e5e50-a667-4ea8-add1-2da77ef4b3a1 on hv-cinder-81883 Nov 22 23:05:21.095983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-3c45050f-abc8-49cd-939b-bdaab1017dab req-f8bde898-fd82-4d84-908f-eed0659fad6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145498 Nov 22 23:05:21.096557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 382/781] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:05:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:05:21.936960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:21.937660 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:21.944066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:21.944516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:21.945324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:21.945823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:22.076416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:22.083722 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d6b31b6f-5ae8-41fa-b845-edde3433b721 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1319 microversion: 2.1 time: 0.151427 Nov 22 23:05:22.084286 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 400/782] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:21 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:23.103633 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:23.104279 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:23.110948 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:23.111401 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:23.112189 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:23.112624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:23.246575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:23.253913 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e82ca67e-4c06-4bb6-8c3a-bba4e79726e3 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1507 microversion: 2.1 time: 0.155316 Nov 22 23:05:23.254486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 383/783] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:23 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:23.270204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41747fe2-b0b1-4e8f-b575-a277d6e9efa4", "device": "/dev/sdb"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:23.271770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:23.278594 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:23.279047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:23.279850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:23.280330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:23.522354 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e5fed96c-1fcd-4d9b-b712-c129e90b5592 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "POST /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255689 Nov 22 23:05:23.526460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 401/784] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:05:23 2021] POST /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:05:33.180748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:05:33.181431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:05:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:05:36.621094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:36.621702 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:36.627575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:36.628022 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:36.628827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:36.629245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:36.709183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lazy-loading 'services' on Instance uuid ce09954f-3efe-4542-9eb8-c1be3bc21549 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:05:36.778761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6e32b399-59ca-48c1-980b-34e276ca9c87 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-volume_attachments/1a05ec09-4c63-4959-aaee-67761b939491" status: 202 len: 0 microversion: 2.1 time: 0.260146 Nov 22 23:05:36.779271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 384/785] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:05:36 2021] DELETE /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-volume_attachments/1a05ec09-4c63-4959-aaee-67761b939491 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:05:37.293241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:05:37.293455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:05:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:05:39.993769 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dbf5b135-3275-4a7c-97d5-ba800f72ef93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:40.000540 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbf5b135-3275-4a7c-97d5-ba800f72ef93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:40.000993 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbf5b135-3275-4a7c-97d5-ba800f72ef93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:40.023200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dbf5b135-3275-4a7c-97d5-ba800f72ef93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Going to try to stop instance {{(pid=116339) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 23:05:40.065135 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dbf5b135-3275-4a7c-97d5-ba800f72ef93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 202 len: 0 microversion: 2.1 time: 0.075630 Nov 22 23:05:40.066071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 402/786] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:05:39 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:05:40.076609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:40.077461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:40.083922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:40.084631 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:40.085419 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:40.085901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:40.228912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:40.236331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bafdc1f3-c8f1-4b7f-8575-d15fb8634a85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.165707 Nov 22 23:05:40.236907 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 385/787] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:40 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:41.255365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:41.256019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:41.262328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:41.262770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:41.263549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:41.263982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:41.398774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:41.406644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0aa5431a-64ca-40fd-b422-f17c46aa8b6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.155770 Nov 22 23:05:41.407216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 403/788] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:41 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:42.423726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:42.424319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:42.430569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:42.431015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:42.431782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:42.432849 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:42.565282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:42.572532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d59442fc-e3da-41bf-bbc4-9ecdaaa5800f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.152412 Nov 22 23:05:42.573160 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 386/789] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:42 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:43.590458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:43.591094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:43.597466 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:43.597956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:43.598733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:43.599172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:43.728735 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:43.737059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-16348ea1-6b6c-434f-8d14-069028618d71 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.151158 Nov 22 23:05:43.737676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 404/790] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:43 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:44.753587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:44.754215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:44.761285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:44.761756 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:44.762534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:44.762960 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:44.903338 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:44.910917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cdadedea-10b7-4343-8f7d-cb0dbc69682a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.160904 Nov 22 23:05:44.911479 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 387/791] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:44 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:45.928007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:45.928825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:45.936178 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:45.936763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:45.937555 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:45.938021 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:46.081673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:46.089454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-63dd2294-23c5-4d93-b0b4-738b5e8b6eff tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.165011 Nov 22 23:05:46.090042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 405/792] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:45 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:47.107604 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:47.108235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:47.114119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:47.114572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:47.115375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:47.115812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:47.252131 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:47.260724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4a12c101-d0ee-4595-a263-e0ca825f7c37 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.157014 Nov 22 23:05:47.271782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 388/793] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:47 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:48.280110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:48.280716 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:48.287261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:48.287705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:48.288500 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:48.288931 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:48.431060 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:48.439087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-97e5257f-7f1a-464e-9197-b6ad0947597d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.162635 Nov 22 23:05:48.439658 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 406/794] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:48 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:48.971607 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:48.972100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:48.978243 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:48.978686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:48.980234 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:48.980666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:49.057255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lazy-loading 'services' on Instance uuid 954e5e50-a667-4ea8-add1-2da77ef4b3a1 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:05:49.127034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f8e711dc-2daf-4922-9542-94585477ffac tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "DELETE /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1/os-volume_attachments/41747fe2-b0b1-4e8f-b575-a277d6e9efa4" status: 202 len: 0 microversion: 2.1 time: 0.158937 Nov 22 23:05:49.127611 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 389/795] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:05:48 2021] DELETE /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1/os-volume_attachments/41747fe2-b0b1-4e8f-b575-a277d6e9efa4 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:05:49.457089 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:49.457680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:49.464224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:49.464672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:49.465552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:49.465912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:49.597215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:49.605319 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32801ba5-8600-4ff3-88ab-e0a675b712ca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.151823 Nov 22 23:05:49.605939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 407/796] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:49 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:50.241144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:50.241844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:50.248924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:50.249375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:50.250178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:50.250623 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:50.275344 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:05:50.350757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-828e02e9-ceb6-40bc-9fc7-0896def90318 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "DELETE /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 204 len: 0 microversion: 2.1 time: 0.113774 Nov 22 23:05:50.351347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 390/797] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:05:50 2021] DELETE /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:05:50.360121 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:50.360835 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:50.367141 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:50.367688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:50.368580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:50.369026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:50.508720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:50.517144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-475bc000-23a3-4277-b8fd-4ff8433beb70 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1513 microversion: 2.1 time: 0.160731 Nov 22 23:05:50.517737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 408/798] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:50 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:50.623381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:50.624083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:50.630148 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:50.630602 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:50.631417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:50.631880 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:50.765270 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:50.773180 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7306213b-5c34-41a1-97df-5ab7a819617f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.154292 Nov 22 23:05:50.773954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 391/799] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:50 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:51.534359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:51.534955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:51.542384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:51.543114 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:51.544178 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:51.544715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:51.678599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:51.687382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-90f865d6-e2d5-4673-9a6e-efb767986296 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1513 microversion: 2.1 time: 0.156624 Nov 22 23:05:51.687958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 409/800] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:51 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:51.792135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:51.792916 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:51.799615 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:51.800075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:51.800876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:51.801311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:51.947312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:51.955707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-59cf3fe4-3989-497c-b07c-fcef8f565e6d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.167986 Nov 22 23:05:51.956350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 392/801] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:51 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:52.705292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:52.705982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:52.712212 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:52.712666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:52.713528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:52.714251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:52.872261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:52.880377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2c8e1855-51af-4f44-8443-8b38a4aa5272 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1513 microversion: 2.1 time: 0.178943 Nov 22 23:05:52.890703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 410/802] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:52 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:52.975842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:52.976668 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:52.983608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:52.984057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:52.984858 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:52.985303 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.138633 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:53.147090 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ea04c7ea-d5b7-49e1-b459-1cb4c28ea0b5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.174883 Nov 22 23:05:53.148311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 393/803] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:52 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:53.290996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-0a57e7b2-2d99-4e66-817e-e88624e913ec req-227a27f7-6f45-4ea0-b991-8d132f9c5851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954e5e50-a667-4ea8-add1-2da77ef4b3a1", "name": "network-vif-deleted", "tag": "3f5004c5-7e65-459b-b915-ffeaedf74541"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:53.293124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:05:53.293124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:05:53.304168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-0a57e7b2-2d99-4e66-817e-e88624e913ec req-227a27f7-6f45-4ea0-b991-8d132f9c5851 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.304804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-0a57e7b2-2d99-4e66-817e-e88624e913ec req-227a27f7-6f45-4ea0-b991-8d132f9c5851 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.318002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-0a57e7b2-2d99-4e66-817e-e88624e913ec req-227a27f7-6f45-4ea0-b991-8d132f9c5851 service nova] Creating event network-vif-deleted:3f5004c5-7e65-459b-b915-ffeaedf74541 for instance 954e5e50-a667-4ea8-add1-2da77ef4b3a1 on hv-cinder-81883 Nov 22 23:05:53.324148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-0a57e7b2-2d99-4e66-817e-e88624e913ec req-227a27f7-6f45-4ea0-b991-8d132f9c5851 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038042 Nov 22 23:05:53.324971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 411/804] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:05:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:05:53.707696 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:53.708194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:53.714995 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.715450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.716240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.716681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.743447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:05:53.818704 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-03874417-98e3-4c20-a728-8cb10929be12 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 204 len: 0 microversion: 2.1 time: 0.114418 Nov 22 23:05:53.819290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 394/805] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:05:53 2021] DELETE /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:05:53.830307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:53.834844 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:53.844185 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.845063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.846266 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.847168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.899718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:53.900434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:53.906314 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.906755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.907552 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.908060 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.942661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:53.943024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:53.943461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lazy-loading 'fault' on Instance uuid 954e5e50-a667-4ea8-add1-2da77ef4b3a1 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:05:53.995490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badb0895df7c4ef09a7ce7962d2d2f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f34c6ad90fb49c1a0d30a5701e0d0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:54.003954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ccc51d26-e7bc-46a3-bce1-11de1d8c35e6 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 200 len: 1309 microversion: 2.1 time: 0.108343 Nov 22 23:05:54.005240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 395/806] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:53 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:54.153233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:54.162972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e44efec1-4878-44d8-a4ea-bbacfdc397f6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1576 microversion: 2.1 time: 0.337595 Nov 22 23:05:54.163541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 412/807] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:53 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1576 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:54.164223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:54.164841 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:54.171339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:54.171791 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:54.172618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:54.174411 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:54.312924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:54.320242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-efa208c6-9137-47ba-81cf-1e36e9212f73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.159945 Nov 22 23:05:54.320805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 396/808] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:54 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:05:55.022238 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:55.022938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] [instance: 954e5e50-a667-4ea8-add1-2da77ef4b3a1] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:55.029410 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:55.029897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:55.030703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:55.031145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:55.045549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] HTTP exception thrown: Instance 954e5e50-a667-4ea8-add1-2da77ef4b3a1 could not be found. Nov 22 23:05:55.046184 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] Returning 404 to user: Instance 954e5e50-a667-4ea8-add1-2da77ef4b3a1 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:05:55.047016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-865b6320-136e-44fd-b5c5-755d7e7821e8 tempest-VolumesSnapshotTestJSON-1053643370 tempest-VolumesSnapshotTestJSON-1053643370-project] 10.222.0.81 "GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1" status: 404 len: 111 microversion: 2.1 time: 0.028472 Nov 22 23:05:55.047565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 413/809] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:55 2021] GET /compute/v2.1/servers/954e5e50-a667-4ea8-add1-2da77ef4b3a1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:05:55.180440 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:55.181074 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:55.188821 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:55.189281 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:55.190100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:55.190652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:55.337811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:55.339319 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:55.345439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:55.346247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:55.346403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:55.346827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:55.347274 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:55.363120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a4b14e44-5330-4f70-8b84-a6f1c08e088f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1576 microversion: 2.1 time: 0.186363 Nov 22 23:05:55.363747 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 397/810] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:55 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:55.489727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:55.497065 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c4f9e139-e97b-4833-8469-c9e14e0394a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.163185 Nov 22 23:05:55.497642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 414/811] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:55 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:05:56.380217 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:56.381390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:56.388955 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:56.389696 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:56.390512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:56.390947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:56.514981 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:56.516305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:56.524265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:56.525349 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:56.526594 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:56.527129 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:56.553891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:56.563825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7fc98706-bfba-4bdf-92a2-8bcf13f40541 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1576 microversion: 2.1 time: 0.186992 Nov 22 23:05:56.564803 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 398/812] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:56 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:56.701478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:56.709149 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dc1b40f1-4f74-4c41-b77b-e95b54c0c491 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.198072 Nov 22 23:05:56.709824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 415/813] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:56 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:56.973663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-37e44bf2-6462-4ab7-a744-bbeede532d25 req-b453e2c1-5037-4069-820a-6eee7d099f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee39353a-7b66-48b7-b735-20f76c7b3545", "name": "network-vif-deleted", "tag": "dacb0548-77df-4148-a7b2-738040851ec4"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:05:56.975529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:05:56.975529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:05:56.985270 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-37e44bf2-6462-4ab7-a744-bbeede532d25 req-b453e2c1-5037-4069-820a-6eee7d099f00 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:56.985790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-37e44bf2-6462-4ab7-a744-bbeede532d25 req-b453e2c1-5037-4069-820a-6eee7d099f00 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:56.998587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-37e44bf2-6462-4ab7-a744-bbeede532d25 req-b453e2c1-5037-4069-820a-6eee7d099f00 service nova] Creating event network-vif-deleted:dacb0548-77df-4148-a7b2-738040851ec4 for instance ee39353a-7b66-48b7-b735-20f76c7b3545 on hv-cinder-81883 Nov 22 23:05:57.004457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-37e44bf2-6462-4ab7-a744-bbeede532d25 req-b453e2c1-5037-4069-820a-6eee7d099f00 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034284 Nov 22 23:05:57.005316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 399/814] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:05:57.581181 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:57.581729 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:57.588639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:57.589301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:57.590499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:57.591106 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:57.663050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:57.671901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aaad553e-8425-4afa-a8a8-2c2279c11e03 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.094226 Nov 22 23:05:57.672816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 416/815] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:57 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:57.727660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:57.729114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:57.736495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:57.737069 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:57.738055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:57.738798 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:57.896315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:57.910789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e326831f-2f00-469a-9992-4c4509c14baa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.186432 Nov 22 23:05:57.911917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 400/816] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:57 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:58.690106 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:58.690635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:58.697132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:58.697912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:58.698917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:58.699384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:58.758494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:58.766287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-46a5503a-fd7d-4fcf-8f01-c61c7e1e56a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.079948 Nov 22 23:05:58.766847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 417/817] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:58 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:58.928181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:58.928793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:58.935270 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:58.935721 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:58.936497 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:58.936945 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:59.079196 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:59.086993 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7a70ba46-1c0f-4ead-9720-0924a5f346d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.162290 Nov 22 23:05:59.087583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 401/818] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:58 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:05:59.783727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:05:59.784334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:05:59.790849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:59.791873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:59.792647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:05:59.793076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:05:59.851706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:05:59.859847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-69fa0d5d-0798-4414-9a8f-1d3996cc0033 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.079768 Nov 22 23:05:59.860402 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 418/819] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:05:59 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:00.104903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:00.105584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:00.111350 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.111802 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.112591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.113031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.155161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:00.155690 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:00.161949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.162406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.163193 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.163650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.188671 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lazy-loading 'flavor' on Instance uuid 818d0284-d432-40e7-8b2c-1f8b98bbf6ad {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:06:00.249163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:00.257171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e6413ac3-f802-4287-af29-bd41315f3582 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.156799 Nov 22 23:06:00.265288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 419/820] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:00 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:00.265449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-00919486-2ab2-4437-b6dd-5490f9a49f11 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "POST /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad/action" status: 202 len: 0 microversion: 2.1 time: 0.208725 Nov 22 23:06:00.265449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 402/821] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:06:00 2021] POST /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:06:00.270342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:00.271051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:00.278296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.278760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.279538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.279994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.415461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:00.423400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b59b414f-23fb-495c-9ef0-9906bb4e9cee tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.156613 Nov 22 23:06:00.424029 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 420/822] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:00 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:00.876864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:00.877565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:00.883750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.884226 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.885717 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:00.886249 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:00.946565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:00.954729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-badf62e4-d38b-4f6d-ab06-6e8bc0086dc6 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.081838 Nov 22 23:06:00.955291 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 403/823] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:00 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:01.274470 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:01.275084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:01.281865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:01.282320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:01.283097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:01.283567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:01.419574 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:01.427205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f312d943-9ef3-4bed-a71a-5315641ea5ef tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.156360 Nov 22 23:06:01.427777 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 421/824] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:01 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:01.439969 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:01.440586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:01.446940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:01.447460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:01.448255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:01.448701 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:01.585913 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:01.593310 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5b7b692f-e11b-49ce-9fce-919912514aa9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.156941 Nov 22 23:06:01.593913 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 404/825] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:01 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:01.971403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:01.972018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:01.977959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:01.978420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:01.979943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:01.980387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:02.048291 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:02.056005 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a82c7a83-069b-443f-b64c-7f264cc246f5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.088366 Nov 22 23:06:02.056570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 422/826] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:01 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:02.444825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:02.445370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:02.452295 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:02.452741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:02.453508 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:02.453972 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:02.585454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:02.593052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d97a4e29-1e77-41ab-9c6e-4b0f0dbe54bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.151971 Nov 22 23:06:02.593662 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 405/827] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:02 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:02.610191 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:02.610833 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:02.617037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:02.617483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:02.618293 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:02.618730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:02.756926 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:02.765141 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a98d0774-3827-457e-bc38-0aa91e2a2581 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.158614 Nov 22 23:06:02.765778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 423/828] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:02 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:03.074213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:03.074852 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:03.083307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:03.083797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:03.084595 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:03.085081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:03.148975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:03.156467 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ac361bb8-dcc6-4a07-96b4-6f9c5f4e0f29 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.087287 Nov 22 23:06:03.157021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 406/829] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:03 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:03.609458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:03.610094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:03.616411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:03.617020 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:03.617602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:03.618051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:03.748015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:03.755411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2201aee2-c936-4a61-888b-e2b96b1c994c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.149645 Nov 22 23:06:03.755960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 424/830] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:03 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:03.781932 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:03.782604 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:03.789170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:03.789634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:03.790438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:03.790923 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:03.925764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:03.933439 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c06fc8ed-d016-49c4-984a-fdb0d7246d71 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.155282 Nov 22 23:06:03.934037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 407/831] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:03 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:04.173024 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:04.173656 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:04.179468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:04.179925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:04.180707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:04.181150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:04.241010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:04.248826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7f22873a-95ac-4bef-9b20-68236347e57e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.079454 Nov 22 23:06:04.249388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 425/832] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:04 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:04.771998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:04.772610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:04.779650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:04.780099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:04.780888 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:04.781328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:04.913925 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:04.922459 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-72d8740a-4077-4c38-826d-fbe9657ab4d5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1678 microversion: 2.1 time: 0.154159 Nov 22 23:06:04.923027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 408/833] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:04 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:04.950246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:04.951086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:04.957674 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:04.958130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:04.958915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:04.959352 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:05.106960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:05.114357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4a2c01e0-edc7-4b43-9a85-894146ddd929 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.168210 Nov 22 23:06:05.114923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 426/834] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:04 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:05.266240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:05.266859 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:05.274273 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:05.276408 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:05.277707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:05.278732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:05.343653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:05.351248 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-78e7ce98-cbba-4b60-ba80-677f80fca8b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 200 len: 1225 microversion: 2.1 time: 0.088580 Nov 22 23:06:05.358031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 409/835] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:05 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:05.939687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:05.940382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:05.946280 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:05.946786 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:05.948213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:05.948640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.095513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:06.117841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-953cecad-4243-4917-83fd-112118071a91 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1655 microversion: 2.1 time: 0.176403 Nov 22 23:06:06.117841 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 427/836] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:05 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:06.129852 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ac919184-f533-4049-96cc-8001a55363be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:06.132814 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:06.133586 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:06.137940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac919184-f533-4049-96cc-8001a55363be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.138397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac919184-f533-4049-96cc-8001a55363be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.142636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.143444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.144501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.145333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.204211 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ac919184-f533-4049-96cc-8001a55363be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Going to try to start instance {{(pid=116338) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 23:06:06.247724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ac919184-f533-4049-96cc-8001a55363be tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action" status: 202 len: 0 microversion: 2.1 time: 0.122047 Nov 22 23:06:06.248468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 410/837] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:06:06 2021] POST /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:06:06.258160 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:06.260640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:06.268513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.268967 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.269936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.270378 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.302298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:06.312084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-02705af3-c62e-44b4-a56f-0519c99023ed tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.183683 Nov 22 23:06:06.318892 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 428/838] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:06 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:06.368878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:06.370334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:06.376736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.377409 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.378478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:06.379000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:06.395558 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] HTTP exception thrown: Instance ee39353a-7b66-48b7-b735-20f76c7b3545 could not be found. Nov 22 23:06:06.396171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Returning 404 to user: Instance ee39353a-7b66-48b7-b735-20f76c7b3545 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:06:06.397013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4631d30c-ea75-4cc1-891d-18122222951b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 404 len: 111 microversion: 2.1 time: 0.032150 Nov 22 23:06:06.397573 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 429/839] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:06 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:06:06.421376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:06.428888 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f600e539-e59e-4196-b16a-91258caefb73 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1664 microversion: 2.1 time: 0.176396 Nov 22 23:06:06.433655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 411/840] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:06 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:06.454412 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-776816601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-283226992", "security_groups": [{"name": "tempest-secgroup-smoke-523553842"}], "block_device_mapping_v2": [{"uuid": "a1e98506-8899-4f65-bf19-c88e6c08bb2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b01dbc7-4a1a-48b9-85b0-7d9ce9e6dcb9"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:06.594895 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] validate_networks() for [('0b01dbc7-4a1a-48b9-85b0-7d9ce9e6dcb9', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:06:07.187725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:06:07.187725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:06:07.188387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:06:07.188628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:06:07.188813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:06:07.199796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:07.200249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:07.201099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:07.201538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:07.218984 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for project 4371c64c75764f9c80faa90370720ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:06:07.223839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for user 4fe1833c77424a2d9ba3d33f1793c9f4 and project 4371c64c75764f9c80faa90370720ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:06:07.285852 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:06:07.287995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1e98506-8899-4f65-bf19-c88e6c08bb2f',volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:06:07.339556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:07.340301 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:07.347506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:07.348369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:07.349394 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:07.350101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:07.436730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e93edbaf-6e52-4329-a52d-e33af86c7028 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.985879 Nov 22 23:06:07.438042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 430/841] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:06:06 2021] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:06:07.447534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:07.448252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:07.454566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:07.455015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:07.456016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:07.456456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:07.565539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:07.575825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d3201fc3-a1b8-4908-83ed-90c1dbca908d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.250401 Nov 22 23:06:07.576455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 412/842] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:07 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:07.587487 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-edc6700c-54ce-41b3-8a33-51ea03112cf4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:07.588956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-edc6700c-54ce-41b3-8a33-51ea03112cf4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:07.655169 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-edc6700c-54ce-41b3-8a33-51ea03112cf4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:07.665157 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-edc6700c-54ce-41b3-8a33-51ea03112cf4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1093 microversion: 2.1 time: 0.087063 Nov 22 23:06:07.666795 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:07.667775 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 413/843] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:07 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:07.675340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cbd06ea6-8e92-4778-9b25-e0d7628bc136 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1664 microversion: 2.1 time: 0.231689 Nov 22 23:06:07.675761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 431/844] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:07 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1664 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:08.594232 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:08.595074 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:08.606635 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:08.607910 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:08.610965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:08.611854 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:08.684876 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:08.686294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:08.698871 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:08.699389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:08.700439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:08.700952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:08.767248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:08.774902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-13783b2e-a921-482d-b8a0-f9ef32febd95 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1209 microversion: 2.1 time: 0.094604 Nov 22 23:06:08.775760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 432/845] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:08 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:08.780143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:08.781340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:08.788803 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:08.789357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:08.790249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:08.791231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:08.892776 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:08.901398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ff072c84-e9bd-4c71-a3c9-ce8922fd9332 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.311987 Nov 22 23:06:08.902035 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 414/846] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:08 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:09.045108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:09.053219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2165d330-3ca4-4526-ac93-844a886219b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1668 microversion: 2.1 time: 0.276253 Nov 22 23:06:09.054881 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 433/847] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:08 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1668 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:09.792338 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:09.793107 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:09.799308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:09.799756 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:09.800665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:09.800983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:09.918615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:09.919230 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:09.925634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:09.926098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:09.926879 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:09.927330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:10.058255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:10.067900 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d5dd54b1-6e15-490e-a1bc-7fbd57e3cfb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1276 microversion: 2.1 time: 0.279261 Nov 22 23:06:10.069254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 415/848] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:09 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:10.177644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:10.189982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-989b0b08-6da5-4c97-bcf3-ca8bc045d944 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.274869 Nov 22 23:06:10.190563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 434/849] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:09 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:10.553257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-2380b964-942f-44ef-a73d-3aa23fd482a4 req-07fe465b-7b69-428f-967e-6cd3825dc681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d45b951-a55d-4405-b588-c9a39961ed7e", "tag": "706f4d9d-ccd1-4156-80f6-be31b459d5bf"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:10.554976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:10.554976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:06:10.567310 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-2380b964-942f-44ef-a73d-3aa23fd482a4 req-07fe465b-7b69-428f-967e-6cd3825dc681 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:10.567765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-2380b964-942f-44ef-a73d-3aa23fd482a4 req-07fe465b-7b69-428f-967e-6cd3825dc681 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:10.579705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-2380b964-942f-44ef-a73d-3aa23fd482a4 req-07fe465b-7b69-428f-967e-6cd3825dc681 service nova] Creating event network-changed:706f4d9d-ccd1-4156-80f6-be31b459d5bf for instance 2d45b951-a55d-4405-b588-c9a39961ed7e on hv-cinder-81883 Nov 22 23:06:10.585159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-2380b964-942f-44ef-a73d-3aa23fd482a4 req-07fe465b-7b69-428f-967e-6cd3825dc681 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126051 Nov 22 23:06:10.585799 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 416/850] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:06:11.088744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:11.089338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:11.095682 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:11.096137 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:11.096921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:11.097359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:11.208478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:11.209438 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:11.215704 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:11.216427 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:11.216932 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:11.217367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:11.344694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:11.352000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-22f657d4-3aff-4a70-99ef-4a4ed4e87b78 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.268246 Nov 22 23:06:11.352569 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 435/851] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:11 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:11.483196 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:11.490637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1eedfce7-6d50-49e3-a995-890390219331 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.286413 Nov 22 23:06:11.491075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 417/852] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:11 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:12.370329 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:12.370917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:12.377164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:12.377610 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:12.378399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:12.378829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:12.507822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:12.508439 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:12.508925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:12.515815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:12.516261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:12.516879 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f02d4143-32d5-4b6c-914b-a0693572f634 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.150772 Nov 22 23:06:12.517041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:12.517451 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 436/853] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:12 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:12.517608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:12.650647 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:12.658155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a56d8ae5-0263-4b5f-96a3-a82b906b5a25 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.153990 Nov 22 23:06:12.658730 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 418/854] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:12 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:13.534144 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:13.534867 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:13.541562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:13.542031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:13.542801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:13.543228 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:13.675583 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:13.676097 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:13.676970 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:13.683891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:13.684292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cd5bae39-8492-45d2-91de-58440a47ac9e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.154874 Nov 22 23:06:13.684733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:13.685152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 437/855] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:13 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:13.692700 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:13.693158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:13.826475 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:13.834015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-43366dc8-1d44-44f8-84cd-7fc533e1bc5e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.161965 Nov 22 23:06:13.834581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 419/856] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:13 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:14.701830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:14.702441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:14.708844 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:14.709292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:14.710639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:14.710639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:14.843436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:14.851279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9b049842-9243-4589-92ac-19fc268e2fe0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.152979 Nov 22 23:06:14.851785 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:14.852164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 438/857] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:14 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:14.852399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:14.859319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:14.859705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:14.860532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:14.861030 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:14.996370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:15.004039 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-165d5006-1cc2-4065-8299-d892dac8bc01 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.155837 Nov 22 23:06:15.004764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 420/858] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:14 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:15.869050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:15.869691 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:15.876097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:15.876627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:15.877558 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:15.878062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:16.020276 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:16.020921 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:16.028860 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:16.029498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:16.030485 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:16.030924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:16.112937 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:16.121071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cea677ca-603f-4296-a7a5-b82e2e2b7058 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.255955 Nov 22 23:06:16.122371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 439/859] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:15 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:16.193026 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:16.200656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-75d59738-b673-4d55-93fa-0aa210af2861 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.184242 Nov 22 23:06:16.201220 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 421/860] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:16 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:17.138410 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:17.139097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:17.145130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:17.145574 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:17.146372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:17.146802 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:17.217761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:17.218368 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:17.225012 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:17.226324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:17.227552 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:17.228580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:17.313893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:17.322687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-36c0cd71-5086-4a8f-b4ee-7287cf7fa95e tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.187815 Nov 22 23:06:17.323398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 440/861] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:17 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:17.392936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:17.401718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-09d081c2-1f89-4b8f-b8e7-b2c86cfe3b4c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.187482 Nov 22 23:06:17.402289 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 422/862] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:17 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:18.339442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:18.340051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:18.346324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:18.346767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:18.347531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:18.347959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:18.419096 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:18.420040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:18.427655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:18.428106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:18.429762 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:18.430539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:18.522678 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:18.531110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6a2ea56c-5b4c-45ec-a3dd-68f7cacc2811 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.195300 Nov 22 23:06:18.531813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 441/863] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:18 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:18.601542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:18.609714 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-41e98101-a9ca-4d39-944e-49766c616222 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.194397 Nov 22 23:06:18.610284 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 423/864] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:18 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:19.549133 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:19.549843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:19.556381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:19.556830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:19.557605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:19.558061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:19.628065 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:19.628677 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:19.637938 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:19.638396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:19.639322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:19.639767 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:19.729857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:19.736163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-efeb6070-20c2-47da-89b1-09947dd0d916 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.190610 Nov 22 23:06:19.736820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 442/865] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:19 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:19.799581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:19.806618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fcd7891f-bd9e-4947-b126-842dd295a5fd tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.182576 Nov 22 23:06:19.807183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 424/866] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:19 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:20.752550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:20.753167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:20.760278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:20.760733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:20.761522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:20.761986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:20.823899 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:20.824536 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:20.830890 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:20.831373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:20.832253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:20.832655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:20.940872 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:20.949645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b7233c7c-2cf7-4cd1-9654-d0dc2042c9b5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.200565 Nov 22 23:06:20.950369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 443/867] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:20 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:21.005141 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:21.012480 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d26dd6b5-1cab-49cc-b8d5-d9c5b8b81425 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.192469 Nov 22 23:06:21.013224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 425/868] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:20 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:21.966913 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:21.967527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:21.973826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:21.974277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:21.975050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:21.975487 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:22.030003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:22.030585 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:22.036937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:22.037381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:22.038269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:22.038729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:22.148997 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:22.156493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-df4ad631-e37c-44e6-bba0-d0360612f026 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.193389 Nov 22 23:06:22.157067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 444/869] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:21 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:22.212100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:22.221707 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9352d89d-7b71-461a-a5c8-1e62c420f77f tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.195537 Nov 22 23:06:22.222274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 426/870] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:22 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:23.173571 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:23.174220 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:23.180813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:23.181571 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:23.182405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:23.182838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:23.239388 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:23.240207 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:23.247360 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:23.248200 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:23.249039 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:23.249530 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:23.350947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:23.359224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d411948e-b33e-4d11-9caa-243bb0bb16c0 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.189590 Nov 22 23:06:23.359810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 445/871] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:23 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:23.421236 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:23.429468 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a3d0a883-b3e6-4745-84bf-3ba56267d751 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.194190 Nov 22 23:06:23.430032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 427/872] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:23 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:24.376899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:24.377427 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:24.384203 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.384684 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.385469 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.385934 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.447132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:24.447758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:24.453778 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.454229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.455026 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.455463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.555007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:24.562992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9a632010-8cce-4390-bd94-12a169a49bed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.190545 Nov 22 23:06:24.563960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 446/873] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:24 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:24.623121 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:24.630645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-530483df-64c7-4570-b8a2-d6cda49c0bd4 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1568 microversion: 2.1 time: 0.187753 Nov 22 23:06:24.631325 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 428/874] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:24 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:24.647214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:24.647783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:24.654094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.654543 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.655439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.656062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.734747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f6cd8cf3-2756-4934-8f96-d31024c748c2 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "POST /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad/action" status: 202 len: 0 microversion: 2.1 time: 0.091171 Nov 22 23:06:24.735858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 447/875] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:06:24 2021] POST /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:06:24.744293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:24.745033 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:24.753827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.754602 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.755617 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:24.756271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:24.958650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:24.966943 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-be2af2ad-f621-4b5e-93b0-cf859bd345ad tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1576 microversion: 2.1 time: 0.227249 Nov 22 23:06:24.967661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 429/876] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:24 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:25.581634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:25.582454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:25.589346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:25.590379 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:25.591267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:25.591635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:25.736633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:25.744643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-08f023f8-7dba-4d76-88bd-7f05d71f5846 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.168337 Nov 22 23:06:25.745207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 448/877] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:25 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:25.988999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:25.990137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:26.000046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:26.000539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:26.001609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:26.002140 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:26.146268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:26.154591 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ff9c2b92-c964-46a5-8e37-94295747cd5a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1518 microversion: 2.1 time: 0.172948 Nov 22 23:06:26.155170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 430/878] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:25 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:26.770626 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:26.772653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-43a8e6ee-3a05-4eb8-8596-1aa621d952f8 req-0a7a1790-45f5-4fad-825a-bd2c0c54f105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d45b951-a55d-4405-b588-c9a39961ed7e", "name": "network-vif-plugged", "status": "completed", "tag": "706f4d9d-ccd1-4156-80f6-be31b459d5bf"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:26.773357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:26.778480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:26.778480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:06:26.789261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:26.794172 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:26.795420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:26.797166 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:26.804362 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-43a8e6ee-3a05-4eb8-8596-1aa621d952f8 req-0a7a1790-45f5-4fad-825a-bd2c0c54f105 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:26.807093 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-43a8e6ee-3a05-4eb8-8596-1aa621d952f8 req-0a7a1790-45f5-4fad-825a-bd2c0c54f105 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:26.831222 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-43a8e6ee-3a05-4eb8-8596-1aa621d952f8 req-0a7a1790-45f5-4fad-825a-bd2c0c54f105 service nova] Creating event network-vif-plugged:706f4d9d-ccd1-4156-80f6-be31b459d5bf for instance 2d45b951-a55d-4405-b588-c9a39961ed7e on hv-cinder-81883 Nov 22 23:06:26.839288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-43a8e6ee-3a05-4eb8-8596-1aa621d952f8 req-0a7a1790-45f5-4fad-825a-bd2c0c54f105 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084412 Nov 22 23:06:26.844613 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 449/879] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:06:27.051791 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:27.068006 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b40e43d7-d44d-42a5-ab9b-eee42f3c97fc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.308145 Nov 22 23:06:27.068632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 431/880] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:26 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:27.180714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:27.183060 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:27.190303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:27.190757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:27.192518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:27.193072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:27.430442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:27.441707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1696062a-5e7c-4b08-9005-a4b7175424f6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.270040 Nov 22 23:06:27.442614 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 450/881] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:27 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:28.085631 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:28.086480 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:28.093801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:28.094268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:28.095259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:28.095695 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:28.460584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:28.461203 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:28.463267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:28.469762 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:28.470455 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:28.470922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1428ddc6-a36f-4356-8f6c-756584c5c50c tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1264 microversion: 2.1 time: 0.389025 Nov 22 23:06:28.471240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:28.471489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 432/882] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:28 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1264 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:28.471672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:28.607241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:28.614553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d94333fc-c619-4c75-be29-80dd4199b81c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.157994 Nov 22 23:06:28.615119 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 451/883] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:28 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:28.859738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-3f131554-0b58-4f42-b2f5-11dd13c0b348 req-210821fc-43e6-4c56-aded-b9c9998f8841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "name": "network-vif-unplugged", "status": "completed", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:28.861297 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:28.861297 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:06:28.868812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3f131554-0b58-4f42-b2f5-11dd13c0b348 req-210821fc-43e6-4c56-aded-b9c9998f8841 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:28.869535 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3f131554-0b58-4f42-b2f5-11dd13c0b348 req-210821fc-43e6-4c56-aded-b9c9998f8841 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:28.880563 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-3f131554-0b58-4f42-b2f5-11dd13c0b348 req-210821fc-43e6-4c56-aded-b9c9998f8841 service nova] Creating event network-vif-unplugged:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:06:28.887070 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-3f131554-0b58-4f42-b2f5-11dd13c0b348 req-210821fc-43e6-4c56-aded-b9c9998f8841 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030622 Nov 22 23:06:28.887673 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 433/884] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:06:29.487473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:29.488083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:29.495146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:29.495667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:29.496523 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:29.496960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:29.633145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:29.634830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:29.635024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:29.641519 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:29.641998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:29.642851 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b143e4ab-4697-412c-94ee-cf24265e34ed tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1451 microversion: 2.1 time: 0.158906 Nov 22 23:06:29.643011 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:29.643391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:29.655199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 452/885] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:29 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:29.659682 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:29.660699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:29.667417 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:29.667869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:29.668657 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:29.669107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:29.860033 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:29.864384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:29.868501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2d8ec8e9-ee7c-4981-be82-bdb188f2c2cc tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.239969 Nov 22 23:06:29.871652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 434/886] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:29 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:29.873008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1698840f-82bf-47e1-9520-75cae55c0086 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1451 microversion: 2.1 time: 0.216777 Nov 22 23:06:29.873682 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 453/887] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:29 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1451 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:30.889798 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:30.890647 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:30.897046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:30.897502 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:30.898315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:30.898761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:31.061312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:31.081715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-53156266-a55d-42d6-b771-46a69ae32a1a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.196596 Nov 22 23:06:31.082808 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 435/888] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:30 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:31.527115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-60425999-5a92-4d78-a8c8-29fe57a2d719 req-568435b7-67e2-49b5-aac1-9dab0751f086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d45b951-a55d-4405-b588-c9a39961ed7e", "tag": "706f4d9d-ccd1-4156-80f6-be31b459d5bf"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:31.528698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:31.528698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:06:31.536317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-60425999-5a92-4d78-a8c8-29fe57a2d719 req-568435b7-67e2-49b5-aac1-9dab0751f086 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:31.536761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-60425999-5a92-4d78-a8c8-29fe57a2d719 req-568435b7-67e2-49b5-aac1-9dab0751f086 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:31.548427 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-60425999-5a92-4d78-a8c8-29fe57a2d719 req-568435b7-67e2-49b5-aac1-9dab0751f086 service nova] Creating event network-changed:706f4d9d-ccd1-4156-80f6-be31b459d5bf for instance 2d45b951-a55d-4405-b588-c9a39961ed7e on hv-cinder-81883 Nov 22 23:06:31.553418 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-60425999-5a92-4d78-a8c8-29fe57a2d719 req-568435b7-67e2-49b5-aac1-9dab0751f086 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030055 Nov 22 23:06:31.554177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 454/889] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:06:32.100229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:32.100832 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:32.107788 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:32.108346 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:32.109085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:32.109532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:32.265732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:32.275577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-36a752e0-b5aa-4719-95cb-6a166ba4212e tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.178719 Nov 22 23:06:32.281691 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 436/890] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:32 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:33.294624 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:33.295459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:33.301776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:33.302232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:33.303015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:33.303488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:33.459553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:33.467600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ccb1bd4c-0fa8-4844-b285-77c09e3afbd6 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.177931 Nov 22 23:06:33.468191 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 455/891] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:33 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:34.483984 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:34.484749 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:34.491348 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:34.491811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:34.492575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:34.493034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:34.628782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:34.637209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b6ba696a-8dd8-4559-b6d7-ac97feb1194d tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.156779 Nov 22 23:06:34.637942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 437/892] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:34 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:35.654325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:35.654916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:35.661644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:35.662094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:35.662886 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:35.663328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:35.808673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:35.816142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-910646b9-c1c7-4c66-95f7-5caf7bc622da tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.165512 Nov 22 23:06:35.817204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 456/893] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:35 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:36.832963 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:36.833580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:36.840291 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:36.840825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:36.841572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:36.842090 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:36.985428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:36.993317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b15fdac9-be91-41ad-b3a7-d74449060189 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.163896 Nov 22 23:06:36.993932 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 438/894] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:36 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:38.009943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:38.010507 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:38.016770 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:38.017232 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:38.018027 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:38.018458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:38.156466 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:38.164008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7d93232c-b17b-44cd-88cf-48f41928c84a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.158041 Nov 22 23:06:38.164572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 457/895] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:38 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:38.839527 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-bc5485b5-8416-41fe-9241-b49307e9f3e8 req-bd160ab9-4b26-494d-87ca-0fca62d61f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "name": "network-vif-plugged", "status": "completed", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:38.841012 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:38.841012 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:06:38.851592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-bc5485b5-8416-41fe-9241-b49307e9f3e8 req-bd160ab9-4b26-494d-87ca-0fca62d61f39 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:38.852046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-bc5485b5-8416-41fe-9241-b49307e9f3e8 req-bd160ab9-4b26-494d-87ca-0fca62d61f39 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:38.864623 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-bc5485b5-8416-41fe-9241-b49307e9f3e8 req-bd160ab9-4b26-494d-87ca-0fca62d61f39 service nova] Creating event network-vif-plugged:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:06:38.875445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-bc5485b5-8416-41fe-9241-b49307e9f3e8 req-bd160ab9-4b26-494d-87ca-0fca62d61f39 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039729 Nov 22 23:06:38.876204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 439/896] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:06:38.948036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:38.948549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:38.954889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:38.955643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:38.956449 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:38.956885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:38.987935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1cbea9e5-0b45-4afa-b5f6-2822bf3bfcce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments/883aa653-e216-406d-bc09-c92dea3acfe7" status: 200 len: 194 microversion: 2.20 time: 0.043764 Nov 22 23:06:38.994656 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 458/897] 10.222.0.81 () {60 vars in 1453 bytes} [Mon Nov 22 23:06:38 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments/883aa653-e216-406d-bc09-c92dea3acfe7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:06:39.050237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:39.050725 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:39.058349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:39.059016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:39.059828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:39.060231 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:39.146490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lazy-loading 'services' on Instance uuid 6383769b-dc5f-4c00-9651-484e2904efcc {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:06:39.181674 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:39.182459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:39.188748 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:39.189196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:39.190007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:39.190445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:39.223521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1a42ef74-3a28-4cd1-841a-6bf9f1f7b894 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments/883aa653-e216-406d-bc09-c92dea3acfe7" status: 202 len: 0 microversion: 2.20 time: 0.176982 Nov 22 23:06:39.224474 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 440/898] 10.222.0.81 () {60 vars in 1456 bytes} [Mon Nov 22 23:06:39 2021] DELETE /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments/883aa653-e216-406d-bc09-c92dea3acfe7 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:06:39.233098 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:39.234137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:39.240736 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:39.241209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:39.242290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:39.242681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:39.276295 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d7f47f4a-c222-48fe-a764-120e04797667 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047375 Nov 22 23:06:39.276997 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 441/899] 10.222.0.81 () {60 vars in 1342 bytes} [Mon Nov 22 23:06:39 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:06:39.345500 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:39.353045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cd6b4ac7-bb63-4daf-a702-feb6b64a99d1 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.175633 Nov 22 23:06:39.353831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 459/900] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:39 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:40.290566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:40.291626 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:40.298609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:40.299178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:40.300285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:40.300809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:40.331876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8ba09714-4bfc-4bdc-aec6-fff5649c38a5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046962 Nov 22 23:06:40.332430 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 442/901] 10.222.0.81 () {60 vars in 1342 bytes} [Mon Nov 22 23:06:40 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:06:40.370595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:40.371265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:40.377745 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:40.378236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:40.379040 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:40.379479 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:40.519981 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:40.528533 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5a2b7a5c-f356-4c3b-96b2-a7e46a7251b9 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1574 microversion: 2.1 time: 0.161980 Nov 22 23:06:40.529115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 460/902] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:40 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:41.343745 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:41.344642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:41.350946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.351397 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.352764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.353202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.382005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7b340352-d0a4-4462-ad3d-469c5e41b2aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042133 Nov 22 23:06:41.382572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 443/903] 10.222.0.81 () {60 vars in 1342 bytes} [Mon Nov 22 23:06:41 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:06:41.439142 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:41.439703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:41.446350 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.446807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.447609 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.448045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.473105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:06:41.548220 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:41.548827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:41.555876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.556954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.558127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.558592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.559520 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-19a01f32-734a-40ec-9caf-bfd62d9b58c4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 204 len: 0 microversion: 2.20 time: 0.123593 Nov 22 23:06:41.560761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 461/904] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Nov 22 23:06:41 2021] DELETE /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 23:06:41.570595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:41.571714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:41.577647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.578296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.578896 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:41.579319 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:41.776423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:41.781042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:41.784207 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8b19f0dd-c124-4173-b366-e15885b9d946 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1561 microversion: 2.1 time: 0.239653 Nov 22 23:06:41.785053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 444/905] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:06:41 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:06:41.790872 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:41.792531 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:41.793782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-17976ad8-7384-4632-8c34-a9cd79492257 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.227140 Nov 22 23:06:41.794337 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 462/906] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:41 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:06:42.812588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:42.813285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:42.819500 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:42.819951 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:42.820728 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:42.821167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:42.950690 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:42.958820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:42.960286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:42.961433 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9267966b-3c44-4a5f-8fa6-55930d307a9c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.152574 Nov 22 23:06:42.962642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 445/907] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:42 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:06:43.980754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:43.981296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:43.987738 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:43.988187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:43.988964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:43.989397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:44.246849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:44.254620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:44.256105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:44.257254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f40b9eb9-6423-4903-bc4c-33b674fc034e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1723 microversion: 2.20 time: 0.280895 Nov 22 23:06:44.257838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 463/908] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:43 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:44.717513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-70656cf7-d3f7-4859-8cc0-f587ade9ea92 req-7d8625fa-bc6e-4e86-8359-65a2373717d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6383769b-dc5f-4c00-9651-484e2904efcc", "name": "network-vif-deleted", "tag": "6aea9cb4-aad8-4449-a8a2-ba1de5bf799a"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:44.719092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:44.719092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:06:44.726272 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-70656cf7-d3f7-4859-8cc0-f587ade9ea92 req-7d8625fa-bc6e-4e86-8359-65a2373717d0 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:44.726718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-70656cf7-d3f7-4859-8cc0-f587ade9ea92 req-7d8625fa-bc6e-4e86-8359-65a2373717d0 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:44.738026 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-70656cf7-d3f7-4859-8cc0-f587ade9ea92 req-7d8625fa-bc6e-4e86-8359-65a2373717d0 service nova] Creating event network-vif-deleted:6aea9cb4-aad8-4449-a8a2-ba1de5bf799a for instance 6383769b-dc5f-4c00-9651-484e2904efcc on hv-cinder-81883 Nov 22 23:06:44.743422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-70656cf7-d3f7-4859-8cc0-f587ade9ea92 req-7d8625fa-bc6e-4e86-8359-65a2373717d0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028875 Nov 22 23:06:44.744161 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 446/909] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:06:45.276656 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:45.277315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:45.283919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:45.284379 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:45.285496 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:45.285976 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:45.319484 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:45.319938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:45.320392 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lazy-loading 'fault' on Instance uuid 6383769b-dc5f-4c00-9651-484e2904efcc {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:06:45.365782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:45.374872 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:45.376399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:45.377562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0282d13d-eb09-4e31-baf4-cd4b3924b1ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 200 len: 1371 microversion: 2.20 time: 0.105213 Nov 22 23:06:45.378151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 464/910] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:45 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:46.398388 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:46.399654 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:46.405820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:46.406265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:46.407031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:46.407461 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:46.421737 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] HTTP exception thrown: Instance 6383769b-dc5f-4c00-9651-484e2904efcc could not be found. Nov 22 23:06:46.422321 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Returning 404 to user: Instance 6383769b-dc5f-4c00-9651-484e2904efcc could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:06:46.423125 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-76e9bc27-8ad6-49b7-be30-61c76ed82086 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 404 len: 111 microversion: 2.20 time: 0.029917 Nov 22 23:06:46.423738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 447/911] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:46 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 23:06:46.431959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d10d743d-fa45-4280-870c-10fec3697338 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '.version_select at 0x7fefc9704670>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:46.453899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d10d743d-fa45-4280-870c-10fec3697338 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-935397359" status: 204 len: 0 microversion: 2.20 time: 0.025609 Nov 22 23:06:46.454501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 465/912] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Nov 22 23:06:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-935397359 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 23:06:47.147726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c8345f91-9b61-44a7-9028-f8bdf4bb6218 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'create', calling method: .version_select at 0x7fefc9f8b5e0>, body: {"keypair": {"name": "tempest-keypair-525895099"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:47.162091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-c8345f91-9b61-44a7-9028-f8bdf4bb6218 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:06:47.165988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-c8345f91-9b61-44a7-9028-f8bdf4bb6218 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for user 66e5af1ce0394d6f963d368036c8c0d5 and project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:06:47.407194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-c8345f91-9b61-44a7-9028-f8bdf4bb6218 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:06:47.411051 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-c8345f91-9b61-44a7-9028-f8bdf4bb6218 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for user 66e5af1ce0394d6f963d368036c8c0d5 and project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:06:47.423600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c8345f91-9b61-44a7-9028-f8bdf4bb6218 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.279687 Nov 22 23:06:47.424201 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 448/913] 10.222.0.81 () {62 vars in 1198 bytes} [Mon Nov 22 23:06:47 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 23:06:48.794644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-467236545", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf77bdb8-32c3-46df-9787-173ffafa8e98"}], "security_groups": [{"name": "tempest-securitygroup--1676503834"}], "key_name": "tempest-keypair-525895099", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:48.895895 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] validate_networks() for [('bf77bdb8-32c3-46df-9787-173ffafa8e98', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:06:49.263528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:06:49.263977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:06:49.264446 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:06:49.264850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:06:49.265325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:06:49.273979 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:49.274400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:49.275180 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:49.275623 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:49.292435 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:06:49.296387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Getting quotas for user 66e5af1ce0394d6f963d368036c8c0d5 and project 387b910bbc6a480a88d07859ab82cfe6. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:06:49.307730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:06:49.310059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:06:49.354263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-eb832f1f-f6ca-4b18-b9a1-fe725f04f184 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.564380 Nov 22 23:06:49.354908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 466/914] 10.222.0.81 () {62 vars in 1187 bytes} [Mon Nov 22 23:06:48 2021] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 23:06:49.364620 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fdeb867e-222f-4092-935a-026e49ee5f70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:49.365237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fdeb867e-222f-4092-935a-026e49ee5f70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:49.421333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fdeb867e-222f-4092-935a-026e49ee5f70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:49.429167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fdeb867e-222f-4092-935a-026e49ee5f70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:49.431527 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fdeb867e-222f-4092-935a-026e49ee5f70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:49.432629 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fdeb867e-222f-4092-935a-026e49ee5f70 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1280 microversion: 2.20 time: 0.071685 Nov 22 23:06:49.433202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 449/915] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:49 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:50.452230 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:50.453795 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:50.461243 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:50.461749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:50.462554 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:50.462992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:50.534107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:50.544224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:50.545760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:50.546886 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d5b91832-80d1-4268-9e3a-df60a3bd8e61 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1338 microversion: 2.20 time: 0.099620 Nov 22 23:06:50.547432 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 467/916] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:50 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:51.565319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:51.565969 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:51.575229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:51.575685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:51.576493 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:51.576927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:51.741761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-e477c77e-5483-42aa-98de-2df6ed3107c5 req-a5d3e7dc-4397-40ae-a2a7-9225cc9251b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:51.744213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:51.744213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:06:51.754083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-e477c77e-5483-42aa-98de-2df6ed3107c5 req-a5d3e7dc-4397-40ae-a2a7-9225cc9251b3 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:51.755219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-e477c77e-5483-42aa-98de-2df6ed3107c5 req-a5d3e7dc-4397-40ae-a2a7-9225cc9251b3 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:51.774575 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-e477c77e-5483-42aa-98de-2df6ed3107c5 req-a5d3e7dc-4397-40ae-a2a7-9225cc9251b3 service nova] Creating event network-changed:8da32319-51d1-4c63-adca-4c2685c82057 for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 on hv-cinder-81883 Nov 22 23:06:51.782391 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-e477c77e-5483-42aa-98de-2df6ed3107c5 req-a5d3e7dc-4397-40ae-a2a7-9225cc9251b3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045526 Nov 22 23:06:51.783358 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 468/917] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:06:51.798678 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:51.811605 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:51.813215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:51.814420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2cf962ce-32c7-41d3-bb51-165a9511938b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.252827 Nov 22 23:06:51.815112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 450/918] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:51 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:52.834120 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:52.834848 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:52.841252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:52.841732 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:52.842521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:52.842961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:52.980418 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:52.988302 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:52.989868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:52.991003 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2c9e08af-4f45-45cf-a2dd-895b5b24413f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.161411 Nov 22 23:06:52.991607 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 469/919] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:52 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:54.009106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:54.009723 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:54.015977 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:54.016424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:54.017190 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:54.017633 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:54.149992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:54.157742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:54.159244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:54.160600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c45522e9-00f0-428c-9ce1-dce6952efeff tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.155213 Nov 22 23:06:54.161158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 451/920] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:54 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:55.178873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:55.179482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:55.185965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:55.186419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:55.187195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:55.187631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:55.317421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:55.325987 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:55.327480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:55.328576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f08aabf4-b0a6-4d60-92b6-963e8dc6ef7b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.153505 Nov 22 23:06:55.329135 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 470/921] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:55 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:56.347011 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:56.347618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:56.353992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:56.354441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:56.355213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:56.355650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:56.485216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:56.493536 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:56.495057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:56.496162 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fa167bc8-36d6-444a-ac9b-d0dc0b9f65c6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.152838 Nov 22 23:06:56.496718 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 452/922] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:56 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:56.918025 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-511ac987-47f9-4eca-b3a0-b06f16ed861c req-15ed5636-7b8a-4cb7-8fd0-bb1a8e3964c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "name": "network-vif-plugged", "status": "completed", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:06:56.919533 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:06:56.919533 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:06:56.926584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-511ac987-47f9-4eca-b3a0-b06f16ed861c req-15ed5636-7b8a-4cb7-8fd0-bb1a8e3964c6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:56.927019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-511ac987-47f9-4eca-b3a0-b06f16ed861c req-15ed5636-7b8a-4cb7-8fd0-bb1a8e3964c6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:56.938977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-511ac987-47f9-4eca-b3a0-b06f16ed861c req-15ed5636-7b8a-4cb7-8fd0-bb1a8e3964c6 service nova] Creating event network-vif-plugged:8da32319-51d1-4c63-adca-4c2685c82057 for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 on hv-cinder-81883 Nov 22 23:06:56.943664 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-511ac987-47f9-4eca-b3a0-b06f16ed861c req-15ed5636-7b8a-4cb7-8fd0-bb1a8e3964c6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030152 Nov 22 23:06:56.944315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 471/923] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:06:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:06:57.514099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:57.514671 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:57.521005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:57.521450 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:57.522244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:57.522673 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:57.651724 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:57.660030 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:57.661524 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:57.662654 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cf9d1c25-21eb-4d79-b6ca-79b79169f208 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.152331 Nov 22 23:06:57.663211 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 453/924] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:57 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:58.684898 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:58.686271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:58.692421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:58.692870 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:58.693668 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:58.694104 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:58.830048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:58.839225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:58.840791 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:06:58.842015 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e2d5b28e-5e69-4575-b544-3a76c290bb34 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1406 microversion: 2.20 time: 0.161980 Nov 22 23:06:58.842588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 472/925] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:58 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:06:59.860403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:06:59.861008 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:06:59.867937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:59.868470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:59.869251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:06:59.869717 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:06:59.998923 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:00.006878 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:00.008544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:00.009712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a489dc06-12a6-4031-a02a-fa4a6250f871 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1598 microversion: 2.20 time: 0.153078 Nov 22 23:07:00.010277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 454/926] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:06:59 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:07:00.026959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:00.027453 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:00.033847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:00.034553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:00.035334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:00.035775 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:00.115839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-779b6c3c-bfc3-4acf-b8de-f04a70497183 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092735 Nov 22 23:07:00.116438 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 473/927] 10.222.0.81 () {60 vars in 1315 bytes} [Mon Nov 22 23:07:00 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:07:01.286729 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-294bc76b-28c2-4677-a707-522e6a7d9450 req-7b2571b8-abb7-402f-8ced-2ed361e46098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:01.288436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:07:01.288436 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:07:01.290210 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:01.291858 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:01.297502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-294bc76b-28c2-4677-a707-522e6a7d9450 req-7b2571b8-abb7-402f-8ced-2ed361e46098 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:01.298076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-294bc76b-28c2-4677-a707-522e6a7d9450 req-7b2571b8-abb7-402f-8ced-2ed361e46098 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:01.303954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:01.304815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:01.306800 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:01.307596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:01.314559 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-294bc76b-28c2-4677-a707-522e6a7d9450 req-7b2571b8-abb7-402f-8ced-2ed361e46098 service nova] Creating event network-changed:8da32319-51d1-4c63-adca-4c2685c82057 for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 on hv-cinder-81883 Nov 22 23:07:01.320127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-294bc76b-28c2-4677-a707-522e6a7d9450 req-7b2571b8-abb7-402f-8ced-2ed361e46098 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037510 Nov 22 23:07:01.321407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 474/928] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:07:01.416560 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a5fc4d61-c89a-44ff-afd2-cc4bc5e6f821 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.133772 Nov 22 23:07:01.417848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 455/929] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:01 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:02.428401 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:02.429388 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:02.436499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:02.437108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:02.437759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:02.438196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:02.527749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6d491055-5c34-40aa-90ca-1700f8d62e53 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.103618 Nov 22 23:07:02.528364 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 475/930] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:02 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:03.539108 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:03.540874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:03.547895 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:03.548343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:03.549120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:03.549557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:03.645128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c1d021a0-29d5-4201-90a9-864b8b257463 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.110332 Nov 22 23:07:03.645816 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 456/931] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:03 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:04.657052 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:04.658004 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:04.666082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:04.666541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:04.667324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:04.667764 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:04.776713 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dbc48c7a-0cef-4b42-834f-11b59d0c2e23 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.123528 Nov 22 23:07:04.777333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 476/932] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:04 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:05.788622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:05.790323 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:05.797174 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:05.797646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:05.798429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:05.798864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:05.903741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b67bae83-b0ea-428e-b387-10b5d07d0b30 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.119394 Nov 22 23:07:05.904385 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 457/933] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:05 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:06.536489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:06.537485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:06.545108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.545558 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.546392 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.546827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.575698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0e80c191-81e5-4d73-9427-d374e2396dca tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043458 Nov 22 23:07:06.576250 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 477/934] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:07:06 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:06.633429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:06.634315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:06.640864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.641309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.642181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.642613 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.668622 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:07:06.748087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6200cdaa-103f-43f9-81d3-c6ecd3ee6e93 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 204 len: 0 microversion: 2.1 time: 0.118737 Nov 22 23:07:06.748940 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 458/935] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:07:06 2021] DELETE /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:07:06.757062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:06.758273 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:06.764578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.765026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.765829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.766264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.905916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:06.913577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d860da91-1704-4580-a85d-b06d71c04249 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1674 microversion: 2.1 time: 0.160181 Nov 22 23:07:06.914354 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 478/936] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:06 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:06.915860 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:06.916873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:06.923924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.924377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:06.925168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:06.925607 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:07.016390 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cf523914-299b-4f52-8831-a046b95b3483 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.104795 Nov 22 23:07:07.017066 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 459/937] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:06 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:07:07.931429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:07.931985 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:07.938320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:07.938772 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:07.939555 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:07.939997 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:08.028094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:08.029126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:08.036456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:08.036908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:08.037728 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:08.038172 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:08.072425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:08.079799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0d0e4235-bd45-4a3c-a6ed-a9e2891d1274 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1674 microversion: 2.1 time: 0.152677 Nov 22 23:07:08.080357 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 479/938] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:07 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:08.186897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7ea8cfd4-0477-4ee9-b94e-f1ef704e0689 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.162560 Nov 22 23:07:08.187609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 460/939] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:08 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:07:09.036813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-20ed6842-c508-40db-9fc4-4c788b553eb3 req-1e3e5ca4-f36d-4c06-9b1e-6eeee3f733a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce09954f-3efe-4542-9eb8-c1be3bc21549", "name": "network-vif-deleted", "tag": "fa888e86-c386-4687-8daf-0f95de7ce011"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:09.038522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:07:09.038522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:07:09.048719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-20ed6842-c508-40db-9fc4-4c788b553eb3 req-1e3e5ca4-f36d-4c06-9b1e-6eeee3f733a0 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:09.049165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-20ed6842-c508-40db-9fc4-4c788b553eb3 req-1e3e5ca4-f36d-4c06-9b1e-6eeee3f733a0 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:09.066938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-20ed6842-c508-40db-9fc4-4c788b553eb3 req-1e3e5ca4-f36d-4c06-9b1e-6eeee3f733a0 service nova] Creating event network-vif-deleted:fa888e86-c386-4687-8daf-0f95de7ce011 for instance ce09954f-3efe-4542-9eb8-c1be3bc21549 on hv-cinder-81883 Nov 22 23:07:09.073042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-20ed6842-c508-40db-9fc4-4c788b553eb3 req-1e3e5ca4-f36d-4c06-9b1e-6eeee3f733a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040037 Nov 22 23:07:09.073681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 480/940] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:07:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:07:09.098553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:09.099269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:09.124271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:09.124898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:09.125770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:09.126358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:09.199608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:09.200951 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:09.209758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:09.210471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:09.213276 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:09.213805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:09.245442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:09.253504 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2bfb3000-df30-46c1-ab34-15efbae8b39c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 200 len: 1322 microversion: 2.1 time: 0.159598 Nov 22 23:07:09.260457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 461/941] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:09 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:09.323603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-99634f50-4ac3-4880-90f3-6d09e96f4924 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.130265 Nov 22 23:07:09.324462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 481/942] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:09 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:10.276947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:10.277553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:10.283800 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:10.284513 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:10.285284 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:10.285743 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:10.299444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] HTTP exception thrown: Instance ce09954f-3efe-4542-9eb8-c1be3bc21549 could not be found. Nov 22 23:07:10.300019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Returning 404 to user: Instance ce09954f-3efe-4542-9eb8-c1be3bc21549 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:07:10.300808 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-192d0e13-6d0a-462d-8a7d-f93708d5b44a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 404 len: 111 microversion: 2.1 time: 0.028360 Nov 22 23:07:10.301324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 462/943] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:10 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:07:10.310972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-848a892a-b461-4d3e-aaee-0def56dec51a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '.version_select at 0x7fefc9798dc0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:10.328510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-848a892a-b461-4d3e-aaee-0def56dec51a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698870683" status: 202 len: 0 microversion: 2.1 time: 0.021613 Nov 22 23:07:10.329063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 482/944] 10.222.0.81 () {58 vars in 1220 bytes} [Mon Nov 22 23:07:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698870683 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:10.334705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:10.335730 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:10.342412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:10.342863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:10.343650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:10.344083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:10.429866 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e52609ea-2449-408a-8d28-aaaa20d0ac1f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.098609 Nov 22 23:07:10.430646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 463/945] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:10 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:10.966299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c02dc9b8-719f-4cac-b654-d7e70c8ed121 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: .version_select at 0x7fefc99c01f0>, body: {"keypair": {"name": "tempest-keypair-1354799337"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:10.982537 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-c02dc9b8-719f-4cac-b654-d7e70c8ed121 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:07:10.986440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-c02dc9b8-719f-4cac-b654-d7e70c8ed121 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for user 2b25dcec4c1f4047ae84ce3572ec4da1 and project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:07:11.214758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-c02dc9b8-719f-4cac-b654-d7e70c8ed121 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:07:11.218247 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-c02dc9b8-719f-4cac-b654-d7e70c8ed121 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for user 2b25dcec4c1f4047ae84ce3572ec4da1 and project 1525897e49c34ebb9215d460e1ad237d. Resources: {'key_pairs'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:07:11.231099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c02dc9b8-719f-4cac-b654-d7e70c8ed121 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.268934 Nov 22 23:07:11.231718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 483/946] 10.222.0.81 () {60 vars in 1157 bytes} [Mon Nov 22 23:07:10 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:11.442658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:11.442658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:11.450055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:11.450515 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:11.451305 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:11.451749 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:11.537346 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e1258916-17d8-47f1-b66c-29f9667311b2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 14 microversion: 2.20 time: 0.100386 Nov 22 23:07:11.540948 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 464/947] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:11 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:12.551583 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:12.554124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:12.562922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:12.563380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:12.564185 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:12.564627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:12.676377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9e9f01dd-5a4c-4c34-b072-557b8b1272c3 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 3741 microversion: 2.20 time: 0.130846 Nov 22 23:07:12.679309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 484/948] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:12 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 3741 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:07:12.775729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-937078072", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "135c9d2c-b547-438e-b31c-2139e85d4ac9"}], "security_groups": [{"name": "tempest-securitygroup--337101801"}], "key_name": "tempest-keypair-1354799337", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:12.887416 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] validate_networks() for [('135c9d2c-b547-438e-b31c-2139e85d4ac9', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:07:13.391013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:07:13.391444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:07:13.391924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:07:13.392343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:07:13.392757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:07:13.404755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:13.405204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:13.406059 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:13.406504 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:13.424509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for project 1525897e49c34ebb9215d460e1ad237d. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:07:13.428375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Getting quotas for user 2b25dcec4c1f4047ae84ce3572ec4da1 and project 1525897e49c34ebb9215d460e1ad237d. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:07:13.440451 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:07:13.442945 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:07:13.493228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8bf95f67-efc6-4800-98f4-dc48e6b8db0b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.722303 Nov 22 23:07:13.493904 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 465/949] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:07:12 2021] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 23:07:13.510282 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-795f4777-afb5-4122-81ea-f27939c6052f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:13.511132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-795f4777-afb5-4122-81ea-f27939c6052f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:13.575672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-795f4777-afb5-4122-81ea-f27939c6052f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:13.582348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-795f4777-afb5-4122-81ea-f27939c6052f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1237 microversion: 2.1 time: 0.079377 Nov 22 23:07:13.582929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 485/950] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:13 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:13.687646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:13.688544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:13.697285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:13.697787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:13.698589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:13.699194 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:13.798634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0affcd36-986b-4a89-a3d7-b7ce8d97a655 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 15025 microversion: 2.20 time: 0.114306 Nov 22 23:07:13.803901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 466/951] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:13 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 15025 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:14.599594 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:14.601143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:14.608442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:14.608897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:14.610018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:14.610476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:14.680316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:14.687849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cc5decf8-861d-408d-a18b-49ccf17b33d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1307 microversion: 2.1 time: 0.091943 Nov 22 23:07:14.688415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 486/952] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:14 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:14.812139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:14.813146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:14.820939 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:14.821395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:14.822216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:14.822653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:14.945966 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3f5864ea-f606-4831-b5f9-fcbbf42f6d56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 18155 microversion: 2.20 time: 0.137462 Nov 22 23:07:14.949653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 467/953] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:14 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 18155 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:15.704669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:15.705256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:15.712558 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:15.713009 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:15.715053 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:15.715497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:15.957962 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:15.962454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:15.963610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:15.970123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6bd5a2cc-daaf-418b-a6eb-eb88207323c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.268919 Nov 22 23:07:15.970740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 487/954] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:15 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:15.982961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:15.983471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:15.984514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:15.985034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:16.021239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-f1501eb4-d10b-498c-a006-5c3b36a9c1fc req-7e49fa6e-d137-4a50-899c-d5397c08d0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01eeecd-0971-4ec1-a627-0446024134fb", "tag": "ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:16.025171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:07:16.025171 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:07:16.036437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f1501eb4-d10b-498c-a006-5c3b36a9c1fc req-7e49fa6e-d137-4a50-899c-d5397c08d0fa service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:16.036921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f1501eb4-d10b-498c-a006-5c3b36a9c1fc req-7e49fa6e-d137-4a50-899c-d5397c08d0fa service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:16.049681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-f1501eb4-d10b-498c-a006-5c3b36a9c1fc req-7e49fa6e-d137-4a50-899c-d5397c08d0fa service nova] Creating event network-changed:ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0 for instance e01eeecd-0971-4ec1-a627-0446024134fb on hv-cinder-81883 Nov 22 23:07:16.055663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-f1501eb4-d10b-498c-a006-5c3b36a9c1fc req-7e49fa6e-d137-4a50-899c-d5397c08d0fa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040243 Nov 22 23:07:16.056466 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 488/955] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:07:16.121841 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-628aa15b-9f9f-4a99-9fd2-2689697f212c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 19342 microversion: 2.20 time: 0.166458 Nov 22 23:07:16.122575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 468/956] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:15 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 19342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:16.988415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:16.989091 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:16.996226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:16.996681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:17.003868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:17.003868 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:17.134617 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:17.135733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:17.142866 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:17.143212 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:17.144003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:17.144625 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:17.226712 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:17.234030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-04837230-5e68-4034-9578-f205b5e406b8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.250169 Nov 22 23:07:17.234596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 489/957] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:16 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:17.242984 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-07659079-00df-4ca4-aeec-4c2c51d6e8c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 22119 microversion: 2.20 time: 0.111411 Nov 22 23:07:17.244117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 469/958] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:17 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 22119 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:18.251669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:18.252211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:18.253824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:18.254819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:18.258979 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:18.259439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:18.260227 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:18.260750 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:18.261874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:18.262327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:18.263108 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:18.263545 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:18.358319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c7e7188e-71f9-4a77-ad94-9ff5ef59d1e5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 23235 microversion: 2.20 time: 0.108233 Nov 22 23:07:18.358985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 470/959] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:18 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 23235 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:18.394642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:18.403143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a6b6e5d9-dbf0-43fa-9f70-c36e2967ecf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.155203 Nov 22 23:07:18.403793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 490/960] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:18 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:19.370696 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:19.371692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:19.378820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:19.379320 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:19.380145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:19.380609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:19.420210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:19.420819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:19.427115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:19.427567 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:19.428344 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:19.428782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:19.481765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-51fd41bd-ad04-47da-bf8b-24bfbd45f46f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 24764 microversion: 2.20 time: 0.115649 Nov 22 23:07:19.482661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 471/961] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:19 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 24764 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:19.563145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:19.570607 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-04e2c3ae-05a3-4330-9e68-789f6586998b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.153937 Nov 22 23:07:19.571162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 491/962] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:19 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:07:20.494502 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:20.495503 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:20.502400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:20.502860 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:20.503643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:20.504082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:20.587179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:20.587778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:20.594189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:20.594634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:20.595439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:20.595869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:20.597262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-54adb4b9-95e3-4fea-ac3b-908a884386db tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 26353 microversion: 2.20 time: 0.107343 Nov 22 23:07:20.598145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 472/963] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:20 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 26353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:20.728094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:20.735363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3eee065c-9d6c-485f-b7cc-35a5b44927a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.151927 Nov 22 23:07:20.735955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 492/964] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:20 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:07:21.608792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:21.609824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:21.616686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:21.617271 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:21.618092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:21.618535 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:21.719559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-96386e2d-3fd5-4f2e-b066-e37537f293d1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 27419 microversion: 2.20 time: 0.114605 Nov 22 23:07:21.720217 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 473/965] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:21 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 27419 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:21.751348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:21.751948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:21.758925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:21.759372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:21.760143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:21.760578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:21.891291 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:21.899386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8871fa12-b54c-42bf-b235-f32bcd4ecf0f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.151633 Nov 22 23:07:21.899949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 493/966] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:21 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:22.732203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:22.733815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:22.740141 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:22.740587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:22.741349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:22.741807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:22.838470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bbf67769-994d-44e7-a3c1-824f1f330af6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 27749 microversion: 2.20 time: 0.110117 Nov 22 23:07:22.839151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 474/967] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:22 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 27749 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:22.916722 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:22.917332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:22.923602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:22.924048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:22.924834 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:22.925268 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:23.025105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-f28c034a-38bb-4630-97c0-c76ea4f89298 req-6589fc20-c4e2-4dda-b5fe-badd653442c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01eeecd-0971-4ec1-a627-0446024134fb", "name": "network-vif-plugged", "status": "completed", "tag": "ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:23.026703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:07:23.026703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:07:23.035119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f28c034a-38bb-4630-97c0-c76ea4f89298 req-6589fc20-c4e2-4dda-b5fe-badd653442c5 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:23.035796 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-f28c034a-38bb-4630-97c0-c76ea4f89298 req-6589fc20-c4e2-4dda-b5fe-badd653442c5 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:23.050257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-f28c034a-38bb-4630-97c0-c76ea4f89298 req-6589fc20-c4e2-4dda-b5fe-badd653442c5 service nova] Creating event network-vif-plugged:ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0 for instance e01eeecd-0971-4ec1-a627-0446024134fb on hv-cinder-81883 Nov 22 23:07:23.056181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-f28c034a-38bb-4630-97c0-c76ea4f89298 req-6589fc20-c4e2-4dda-b5fe-badd653442c5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035482 Nov 22 23:07:23.056944 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 475/968] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:07:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:07:23.069236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:23.078304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aed5ad65-2e39-4e99-8463-cc23e046d6ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.166190 Nov 22 23:07:23.078916 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 494/969] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:22 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:23.850760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:23.851791 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:23.857876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:23.858316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:23.859085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:23.859514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:24.017906 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-357b525c-1fd9-42fa-aaaa-5c1601175304 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28077 microversion: 2.20 time: 0.171326 Nov 22 23:07:24.018815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 476/970] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:23 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28077 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:24.094830 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:24.095407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:24.101719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:24.102170 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:24.102942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:24.103375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:24.236631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:24.244553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9d093adb-22a4-4ca0-8ae6-9e568e1f171a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1362 microversion: 2.1 time: 0.153379 Nov 22 23:07:24.245120 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 495/971] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:24 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:25.029484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:25.030554 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:25.037943 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:25.038398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:25.039366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:25.039813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:25.155402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bfdf5b79-274e-4448-8954-873b031632bb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.129683 Nov 22 23:07:25.155965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 477/972] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:25 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:25.262236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:25.262854 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:25.269154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:25.269599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:25.270407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:25.270840 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:25.400705 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:07:25.408321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2a3edd13-0e97-45cd-ad02-f5dfac710eee tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1548 microversion: 2.1 time: 0.149880 Nov 22 23:07:25.408815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 496/973] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:07:25 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:25.425608 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:07:25.426204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:25.433601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:25.434081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:25.434853 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:25.435282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:25.515521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0ec256a7-ae35-4899-857e-7f08d7093dc5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093869 Nov 22 23:07:25.516153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 478/974] 10.222.0.81 () {58 vars in 1274 bytes} [Mon Nov 22 23:07:25 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:07:26.167982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:26.168924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:26.174875 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:26.175331 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:26.176105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:26.176537 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:26.266751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f154c183-beb5-45e9-b76f-d979c58d5d3e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.102575 Nov 22 23:07:26.267850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 497/975] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:26 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:26.466447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-8e462aff-4a64-4655-aac7-1a4e4782583e req-3ffff073-b44c-4bbf-a35d-fdbde7961e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01eeecd-0971-4ec1-a627-0446024134fb", "tag": "ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:26.468123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:07:26.468123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:07:26.470309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:26.471797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:26.476688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-8e462aff-4a64-4655-aac7-1a4e4782583e req-3ffff073-b44c-4bbf-a35d-fdbde7961e60 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:26.477123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-8e462aff-4a64-4655-aac7-1a4e4782583e req-3ffff073-b44c-4bbf-a35d-fdbde7961e60 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:26.480809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:26.481466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:26.482441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:26.483045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:26.490578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-8e462aff-4a64-4655-aac7-1a4e4782583e req-3ffff073-b44c-4bbf-a35d-fdbde7961e60 service nova] Creating event network-changed:ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0 for instance e01eeecd-0971-4ec1-a627-0446024134fb on hv-cinder-81883 Nov 22 23:07:26.496375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-8e462aff-4a64-4655-aac7-1a4e4782583e req-3ffff073-b44c-4bbf-a35d-fdbde7961e60 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033727 Nov 22 23:07:26.497780 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 498/976] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:07:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:07:26.582213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a5469ed8-1d67-460f-a386-b5dcfc5cc5ed tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.122154 Nov 22 23:07:26.582875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 479/977] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:26 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:27.280085 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:27.281058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:27.287495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:27.287943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:27.289294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:27.289758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:27.377105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-708fd714-0b52-46ca-84a9-0e7e85a03550 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.101249 Nov 22 23:07:27.377787 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 499/978] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:27 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:27.593288 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:27.594318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:27.601753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:27.602213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:27.602987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:27.603423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:27.693520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c03b9954-11a2-4355-9469-693929e01255 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.104098 Nov 22 23:07:27.694202 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 480/979] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:27 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:28.389665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:28.390666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:28.398258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:28.398730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:28.399617 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:28.400041 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:28.493743 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0834a6cc-c8df-4ce1-8826-b3c66446aeb6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.107942 Nov 22 23:07:28.494391 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 500/980] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:28 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:28.705486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:28.706455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:28.713914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:28.714367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:28.715149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:28.715594 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:28.797398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b947974e-e1eb-402e-be5d-c738f50397f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.095876 Nov 22 23:07:28.798054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 481/981] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:28 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:29.505999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:29.507718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:29.514673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:29.515131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:29.515910 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:29.516345 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:29.720299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fc8cb83e-97ee-4da7-9ae1-b4641ec52bcf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.218242 Nov 22 23:07:29.720949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 501/982] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:29 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:29.809136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:29.810223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:29.817159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:29.817597 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:29.818391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:29.818823 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:29.910469 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bed08b8e-a78a-49c4-8d1c-0b2d9365d307 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.105030 Nov 22 23:07:29.911105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 482/983] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:29 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:30.732905 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:30.733920 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:30.740761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:30.741214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:30.742330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:30.742775 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:30.829107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8e18c41a-b52a-48cf-8bae-4a6d5e7a0f85 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.100121 Nov 22 23:07:30.829811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 502/984] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:30 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:30.922243 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:30.923237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:30.930748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:30.931205 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:30.931987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:30.932425 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:31.019502 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bafcd01d-e8da-4a94-8aaa-6fbbeddf33fe tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.101096 Nov 22 23:07:31.020123 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 483/985] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:30 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:31.841675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:31.843147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:31.850037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:31.850482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:31.851989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:31.852424 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:31.954529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-71ae00f0-8ec6-4748-b4de-25d0592fcb4d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.116651 Nov 22 23:07:31.955159 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 503/986] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:31 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:32.030618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:32.031607 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:32.039331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:32.039775 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:32.040542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:32.040973 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:32.139193 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-80411fa8-3186-411f-8c99-ae1f6f994619 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.112305 Nov 22 23:07:32.139735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 484/987] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:32 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:32.967292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:32.968292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:32.975237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:32.976200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:32.976974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:32.977408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:33.067698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f1c1f633-9112-4812-912a-244e391ac875 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.104402 Nov 22 23:07:33.068385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 504/988] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:32 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:33.151521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:33.152596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:33.159805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:33.160247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:33.161030 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:33.161473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:33.249063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-276c9cef-d7e6-4970-ae4e-c2a5863270c6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.102100 Nov 22 23:07:33.249793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 485/989] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:33 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:34.080069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:34.080965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:34.088328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:34.088805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:34.089653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:34.090134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:34.175963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b9df4f9b-3a09-4f0b-8726-59da94d2752e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.099936 Nov 22 23:07:34.176626 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 505/990] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:34 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:34.261020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:34.262061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:34.268933 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:34.269377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:34.270182 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:34.270614 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:34.349768 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b54d84ba-8645-4fbb-acf2-f98c41940ce6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.092920 Nov 22 23:07:34.350291 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 486/991] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:34 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:35.188644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:35.189558 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:35.196856 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:35.197312 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:35.198128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:35.198569 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:35.285461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-11a7af7b-a0d1-4c1d-a13c-2437ada0a7aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.100741 Nov 22 23:07:35.286634 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 506/992] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:35 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:35.361430 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:35.362586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:35.370443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:35.370895 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:35.371670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:35.372106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:35.451597 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e38a8e04-287d-4fdb-86f4-a510746a12d9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.093963 Nov 22 23:07:35.452133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 487/993] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:35 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 23:07:36.298492 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:36.299497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:36.307421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:36.307874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:36.308659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:36.309101 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:36.405342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-42c5a642-6cdd-4596-865e-3d9b670278ca tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.110762 Nov 22 23:07:36.406281 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 507/994] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:36 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:36.463760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:36.464779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:36.471667 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:36.472113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:36.472897 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:36.473334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:36.561049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f6384a32-f0f5-4f92-9498-e9c3e2ac29c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.102148 Nov 22 23:07:36.561589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 488/995] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:36 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:37.417361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:37.418383 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:37.425240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:37.425719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:37.426495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:37.426935 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:37.516957 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8016981a-d4d1-44b2-85d5-d5a72c4ee37c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.104053 Nov 22 23:07:37.517655 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 508/996] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:37 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:37.572075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:37.573050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:37.579812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:37.580259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:37.581031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:37.581463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:37.680695 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-05b90b55-ef9a-4afe-a315-16aad464006e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 14 microversion: 2.1 time: 0.112364 Nov 22 23:07:37.681518 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 489/997] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:37 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:07:38.529126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:38.530080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:38.537304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:38.537827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:38.539038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:38.539483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:38.628124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-46a06038-0727-48a5-b20a-c815f6c5788b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.102833 Nov 22 23:07:38.628755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 509/998] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:38 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:38.692628 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:38.693632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:38.700789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:38.701254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:38.702051 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:38.702482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:38.813298 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-75ad0880-5c77-446d-bcf3-924650d38497 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 7493 microversion: 2.1 time: 0.124428 Nov 22 23:07:38.814110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 490/999] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:38 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 7493 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:07:39.640924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:39.641952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:39.649078 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:39.649526 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:39.650338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:39.650780 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:39.750444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0eca403a-6a33-4796-937e-d6874d5a8128 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28194 microversion: 2.20 time: 0.113499 Nov 22 23:07:39.751081 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 510/1000] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:39 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:39.824237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:39.825230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:39.832144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:39.832599 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:39.833376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:39.833850 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:39.949265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6206c579-28a2-45b2-80ea-baac6a99ff2c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 15025 microversion: 2.1 time: 0.128747 Nov 22 23:07:39.949862 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 491/1001] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:39 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 15025 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:07:40.762591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:40.763496 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:40.770393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:40.770839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:40.771606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:40.772034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:40.887466 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-48890642-c219-4285-a264-f3bd07f3c0c5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28485 microversion: 2.20 time: 0.128824 Nov 22 23:07:40.888115 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 511/1002] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:40 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28485 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:40.962824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:40.963822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:40.970875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:40.971316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:40.972087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:40.972517 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:41.089518 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6cc94d53-74dd-4f97-a317-65e2b58d688d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 18083 microversion: 2.1 time: 0.132554 Nov 22 23:07:41.090205 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 492/1003] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:40 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 18083 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:41.898665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:41.899680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:41.906784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:41.907233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:41.908008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:41.908441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:42.017575 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-63e75cf2-be7b-45d0-958c-aadc87f22f43 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28651 microversion: 2.20 time: 0.122839 Nov 22 23:07:42.018640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 512/1004] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:41 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28651 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:42.101864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:42.102801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:42.109723 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:42.110175 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:42.110958 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:42.111405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:42.234338 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a1a71123-d7ea-4877-a4e5-f2ebdb35ae85 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 19342 microversion: 2.1 time: 0.136817 Nov 22 23:07:42.234994 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 493/1005] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:42 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 19342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:43.030011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:43.031030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:43.038110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:43.038662 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:43.039430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:43.039861 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:43.170737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ffebb25b-7743-496c-b884-59fbc222b07e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.144480 Nov 22 23:07:43.171303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 513/1006] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:43 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:43.246750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:43.247739 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:43.254604 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:43.255050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:43.255824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:43.256257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:43.360087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1f1297e4-95d0-49de-917c-dadb84c45019 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 21344 microversion: 2.1 time: 0.117167 Nov 22 23:07:43.360731 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 494/1007] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:43 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 21344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:44.183167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:44.184082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:44.191138 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:44.191589 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:44.192370 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:44.192810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:44.292512 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e7b99f74-7976-45c6-8f11-29cc02a8e609 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.113450 Nov 22 23:07:44.293173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 514/1008] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:44 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:44.372113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:44.373100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:44.379946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:44.380404 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:44.381179 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:44.382204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:44.486126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9ba99822-8f93-404d-be3f-e3cf6f1e00c7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 22987 microversion: 2.1 time: 0.117728 Nov 22 23:07:44.486896 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 495/1009] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:44 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 22987 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:45.304983 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:45.306035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:45.312982 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:45.313430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:45.314236 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:45.314673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:45.401810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-55696139-cf3d-4bc8-8588-3b3fd8c5d584 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.100910 Nov 22 23:07:45.402486 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 515/1010] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:45 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:45.497884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:45.498916 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:45.505881 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:45.506369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:45.507453 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:45.507896 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:45.609068 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-935aa884-997d-49d9-92ac-ba3c70868068 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 24381 microversion: 2.1 time: 0.115000 Nov 22 23:07:45.609625 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 496/1011] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:45 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 24381 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:46.415034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:46.416047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:46.423073 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:46.423526 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:46.424324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:46.424761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:46.512346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-54a8b1ac-9f64-49f6-86a0-5ab06885a3c0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.102021 Nov 22 23:07:46.513006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 516/1012] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:46 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:46.621319 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:46.622961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:46.629885 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:46.630334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:46.631106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:46.631589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:46.722078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1c442275-da6e-4ddf-9bc6-d13cfb921b9b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 25904 microversion: 2.1 time: 0.104467 Nov 22 23:07:46.722627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 497/1013] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:46 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 25904 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:47.524874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:47.525902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:47.532875 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:47.533324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:47.534406 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:47.534826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:47.636719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-286219bb-c35b-4561-a00f-797d7bef19cc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.116097 Nov 22 23:07:47.637359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 517/1014] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:47 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:47.734565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:47.735564 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:47.743126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:47.743581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:47.744361 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:47.744798 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:47.847328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-833c4df6-03f4-454b-b508-58e47b1dfd96 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 27064 microversion: 2.1 time: 0.116570 Nov 22 23:07:47.847988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 498/1015] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:47 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 27064 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:48.648593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:48.649876 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:48.659153 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:48.659603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:48.660392 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:48.660832 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:48.752956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-17e3fc2b-6665-47cb-9d07-02bef220c639 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.107965 Nov 22 23:07:48.754303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 518/1016] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:48 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:48.860412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:48.861400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:48.869086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:48.869566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:48.870387 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:48.870823 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:48.978050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-52fd33fb-62f6-424c-b673-fbc7655a87d2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 27727 microversion: 2.1 time: 0.121412 Nov 22 23:07:48.978610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 499/1017] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:48 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 27727 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:49.766294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:49.767291 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:49.774231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:49.774681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:49.775459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:49.775898 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:49.859309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fa4f1b78-d89f-403b-ba41-445585c3fa57 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.097039 Nov 22 23:07:49.859958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 519/1018] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:49 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:49.989896 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:49.991446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:49.998334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:49.998773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:49.999540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:49.999966 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:50.110902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3dede3c9-599b-4574-b6b7-3bf2e559fd13 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28090 microversion: 2.1 time: 0.124788 Nov 22 23:07:50.111579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 500/1019] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:49 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28090 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:50.871810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:50.872811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:50.879844 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:50.880278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:50.881058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:50.882287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:50.976734 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-72c0c8e0-0377-4a9c-a50d-0ccd1e858d14 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.108937 Nov 22 23:07:50.977372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 520/1020] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:50 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:51.124717 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:51.125644 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:51.133109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:51.133549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:51.134341 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:51.134773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:51.232484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a6f91250-eb95-40e2-bff3-4354d14fc98c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.111545 Nov 22 23:07:51.233374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 501/1021] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:51 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:51.988869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:51.989893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:51.996857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:51.997304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:51.998108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:51.998542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:52.091143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-db7ad2b9-ba6f-430f-9ad6-6d561a8ba116 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.106053 Nov 22 23:07:52.091740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 521/1022] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:51 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:52.244703 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:52.245732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:52.255442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:52.255930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:52.256905 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:52.257459 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:52.349170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8d220044-1216-424e-8317-903e4fae7ce4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.108388 Nov 22 23:07:52.350149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 502/1023] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:52 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:53.103322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:53.104350 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:53.111973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:53.112423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:53.113214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:53.113681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:53.205964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d4d98856-d277-48d3-bd04-427be3a54a32 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.107003 Nov 22 23:07:53.206977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 522/1024] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:53 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:53.360930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:53.361865 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:53.369538 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:53.370037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:53.370817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:53.371250 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:53.455820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b18d2706-5e9d-4666-a5e4-818da9b3552c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.098835 Nov 22 23:07:53.456763 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 503/1025] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:53 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:07:54.218853 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:54.219763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:54.227013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:54.227458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:54.228252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:54.228687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:54.317810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9af20d0d-e036-4228-81d8-d77752bd3014 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.103056 Nov 22 23:07:54.318478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 523/1026] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:54 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:54.468586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:54.469655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:54.476636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:54.477078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:54.477894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:54.478336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:54.582387 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8f1db160-d7bd-422b-b4a5-34f7aa8acb99 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.117708 Nov 22 23:07:54.583077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 504/1027] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:54 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:55.331782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:55.332778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:55.340717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:55.341200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:55.342019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:55.342461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:55.424697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cdbfe2eb-b9ed-4895-8a5b-6a1cef9c83af tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.096775 Nov 22 23:07:55.425400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 524/1028] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:55 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:07:55.596387 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:55.597323 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:55.604101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:55.604545 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:55.605309 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:55.605774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:55.700992 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9c0b876b-37b7-4e7d-bd05-ac56e638a56c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.108498 Nov 22 23:07:55.701658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 505/1029] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:55 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:56.437068 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:56.438155 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:56.446468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:56.446917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:56.447698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:56.448132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:56.532552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-31d63563-af53-4b66-9272-8651bdcba6ac tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.098631 Nov 22 23:07:56.532552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 525/1030] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:56 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:56.712972 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:56.713918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:56.720877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:56.721358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:56.722168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:56.722632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:56.806930 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5ec525b5-c294-4463-aa01-c4213fce5496 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.097872 Nov 22 23:07:56.807561 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 506/1031] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:56 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:57.545579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:57.546614 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:57.553476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:57.553959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:57.554739 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:57.555187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:57.636893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-868c17a7-999e-4a04-941e-1083c70d55a8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.095407 Nov 22 23:07:57.637524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 526/1032] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:57 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:57.820380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:57.820792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:57.827686 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:57.828146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:57.828919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:57.829349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:57.915272 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a390b95c-705f-4ef4-9b2f-80252c4e1ef8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.099880 Nov 22 23:07:57.915983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 507/1033] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:57 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:58.648688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:58.649717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:58.656484 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:58.656927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:58.657722 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:58.658154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:58.746188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a3e8a373-5220-476f-8b10-5b9973de00d5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.101361 Nov 22 23:07:58.747163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 527/1034] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:58 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:07:58.927611 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:58.928694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:58.935655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:58.936102 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:58.936879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:58.937315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:59.019866 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b4d310b7-215b-452f-96b1-71569f24dc92 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.096236 Nov 22 23:07:59.020525 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 508/1035] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:07:58 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:07:59.758725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:07:59.759749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:07:59.766897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:59.767345 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:59.768158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:07:59.768596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:07:59.853904 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1ed41dcb-ca2c-467b-a4f5-2f6b51bab0d8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.100115 Nov 22 23:07:59.854546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 528/1036] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:07:59 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:00.032692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:00.033982 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:00.042313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:00.042766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:00.043573 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:00.044020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:00.131209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-db9cf59a-a95d-4926-9da2-788478cc7007 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.102304 Nov 22 23:08:00.132063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 509/1037] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:00 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:00.865495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:00.866572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:00.873502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:00.873985 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:00.874773 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:00.875209 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:00.968507 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-975b16f6-a9e4-4589-a371-dddbaa42e037 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.106960 Nov 22 23:08:00.969141 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 529/1038] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:00 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:01.143729 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:01.144623 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:01.151553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:01.152005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:01.152782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:01.153219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:01.245540 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0cb09c02-5411-4288-8337-6e731ef935d3 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.105732 Nov 22 23:08:01.246473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 510/1039] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:01 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:01.981387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:01.982374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:01.989165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:01.989632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:01.990441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:01.991212 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:02.084734 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ffa2f293-962e-40b6-9f5e-ba7b09d59f56 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.106665 Nov 22 23:08:02.085644 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 530/1040] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:01 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:08:02.258496 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:02.259431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:02.266634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:02.266981 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:02.267756 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:02.268188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:02.353098 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fa89c49e-5fb8-4d8b-80ac-0f5d3adf94ac tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.100220 Nov 22 23:08:02.353784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 511/1041] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:02 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:03.096865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:03.097893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:03.105387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:03.105816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:03.106593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:03.107032 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:03.197914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8fddeefd-8b9d-49a3-888a-7123629ec4eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.104865 Nov 22 23:08:03.198855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 531/1042] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:03 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:03.365446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:03.366375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:03.373172 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:03.373637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:03.374425 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:03.374856 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:03.464399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ded2a388-ff0b-4f15-8ea6-5d58349e00dc tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.102984 Nov 22 23:08:03.465052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 512/1043] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:03 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:04.210693 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:04.211619 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:04.218557 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:04.219013 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:04.219815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:04.220239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:04.307606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-676502f1-19ff-49f3-a148-c55761abdfba tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.101266 Nov 22 23:08:04.308263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 532/1044] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:04 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:04.476837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:04.477863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:04.484758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:04.485209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:04.486015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:04.486449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:04.574245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-75b98603-88f4-443d-989e-4c479111c44d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28191 microversion: 2.1 time: 0.101833 Nov 22 23:08:04.575139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 513/1045] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:04 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:05.319725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:05.320785 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:05.327717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:05.328186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:05.328989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:05.329428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:05.421493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fd389c64-8150-49bc-bcbd-c5ea9ee4546f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.106186 Nov 22 23:08:05.422194 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 533/1046] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:05 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:05.586381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:05.587291 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:05.594100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:05.594551 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:05.595321 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:05.595752 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:05.693979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-69722dd2-18c9-4a9d-a00f-f48975b27415 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28482 microversion: 2.1 time: 0.110842 Nov 22 23:08:05.695038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 514/1047] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:05 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28482 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:06.433760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:06.434747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:06.441529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:06.442030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:06.442795 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:06.443296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:06.529666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-25dda667-17cd-42f9-aabf-c76c88a404aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.099488 Nov 22 23:08:06.532489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 534/1048] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:06 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:06.706503 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:06.707404 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:06.715132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:06.715576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:06.716342 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:06.716770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:06.814109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a492a6bf-de4e-4815-af63-a0b756a11f78 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.111503 Nov 22 23:08:06.814777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 515/1049] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:06 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:07.544549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:07.545568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:07.552425 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:07.553450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:07.554246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:07.554675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:07.636597 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e829d532-d428-4469-89ad-c40788647e63 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.096584 Nov 22 23:08:07.637469 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 535/1050] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:07 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:07.826350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:07.827364 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:07.835677 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:07.836139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:07.836941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:07.837387 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:07.921913 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-756d6076-076e-4fac-8b9f-b5644158c9a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.099602 Nov 22 23:08:07.922557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 516/1051] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:07 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:08.649600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:08.650529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:08.657404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:08.657906 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:08.658942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:08.659378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:08.745162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f78d71bd-1fe7-4532-abb5-0a979208e212 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.100218 Nov 22 23:08:08.745805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 536/1052] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:08 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:08.933484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:08.934425 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:08.941276 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:08.941796 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:08.942580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:08.943014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:09.028470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b6495ca6-3b76-4d00-8248-baa9152d53ba tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.098992 Nov 22 23:08:09.029099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 517/1053] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:08 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:09.757124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:09.758179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:09.764952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:09.765404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:09.766205 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:09.766635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:09.848024 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-80ae2f31-b405-4dc2-860b-d4d30af3163e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.094885 Nov 22 23:08:09.849249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 537/1054] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:09 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:10.041558 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:10.042589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:10.049534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:10.050018 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:10.050830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:10.051269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:10.141668 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-04dc1774-729d-48ae-bc61-ee489670dd69 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.104932 Nov 22 23:08:10.142314 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 518/1055] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:10 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:10.860858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:10.861898 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:10.869553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:10.870032 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:10.870815 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:10.871253 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:10.958331 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9f7bda6b-f541-4ca2-bc65-76ce01c3e068 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.101402 Nov 22 23:08:10.959063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 538/1056] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:10 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:11.154914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:11.156868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:11.163506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:11.163966 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:11.164748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:11.165192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:11.249736 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4901c224-2e12-49f5-bb5b-5b091b247b19 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.098719 Nov 22 23:08:11.250385 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 519/1057] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:11 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:11.970878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:11.971880 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:11.979528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:11.979995 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:11.980756 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:11.981193 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:12.079356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-2ba549ce-35c9-4126-b174-22d070df7928 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 28653 microversion: 2.20 time: 0.112272 Nov 22 23:08:12.079928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 539/1058] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:11 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 28653 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:12.262714 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:12.263736 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:12.269912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:12.270363 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:12.271624 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:12.272063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:12.360381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b3c1feab-b6b5-414d-b3c5-a8c953b1b0aa tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.102099 Nov 22 23:08:12.360944 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 520/1059] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:12 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:13.091350 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:13.092363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:13.099416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:13.099983 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:13.100763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:13.101196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:13.197746 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ddaf7c0d-1564-46c1-aa8d-91c03a8841dd tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 29581 microversion: 2.20 time: 0.110275 Nov 22 23:08:13.198668 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 540/1060] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:13 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 29581 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:13.372834 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:13.373764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:13.380601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:13.381138 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:13.381954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:13.382420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:13.467234 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-52d50215-fb7e-4b3c-a0fb-d966fd3658b2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.098295 Nov 22 23:08:13.467881 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 521/1061] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:13 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:14.210194 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:14.211106 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:14.218251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:14.218706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:14.219526 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:14.219963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:14.321929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-21bf0ae9-9234-4ed0-bb9f-3034be562539 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 31663 microversion: 2.20 time: 0.116292 Nov 22 23:08:14.322822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 541/1062] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:14 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 31663 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:14.479586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:14.480500 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:14.487521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:14.487974 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:14.488750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:14.489187 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:14.576442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a8ba50f4-395f-4ecd-a820-f9eec5c00ad9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.100765 Nov 22 23:08:14.577325 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 522/1063] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:14 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:15.339895 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:15.340889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:15.347838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:15.348285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:15.349059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:15.350203 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:15.445888 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a2d7cbbd-1f49-4d25-8cb1-e4d522f70f2a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 33267 microversion: 2.20 time: 0.109857 Nov 22 23:08:15.446800 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 542/1064] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:15 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 33267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:15.589279 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:15.590342 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:15.597098 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:15.597544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:15.598335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:15.598766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:15.684594 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b5da258d-ec78-4996-afe3-9b95cd9bd8b9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.099959 Nov 22 23:08:15.685268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 523/1065] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:15 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:16.458105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:16.459158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:16.466140 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:16.466591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:16.467389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:16.467824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:16.564875 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b35fa28a-d6e9-431c-aa52-9d907a66b21c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 34244 microversion: 2.20 time: 0.110662 Nov 22 23:08:16.565522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 543/1066] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:16 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 34244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:16.697555 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:16.698618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:16.705534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:16.706014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:16.706797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:16.707237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:16.793804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-eb321aee-0fc8-41cd-b94a-26694af8eeae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.101108 Nov 22 23:08:16.794483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 524/1067] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:16 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:17.578034 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:17.579026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:17.586498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:17.586948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:17.587722 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:17.588161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:17.688234 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f50c7a27-d12d-4435-843a-2eef956972d9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 35488 microversion: 2.20 time: 0.114155 Nov 22 23:08:17.688899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 544/1068] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:17 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 35488 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:08:17.805912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:17.806912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:17.813738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:17.814188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:17.814961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:17.815396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:18.053829 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-400dc3c7-fc46-4066-8b64-b597ce42a8a6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.251756 Nov 22 23:08:18.054481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 525/1069] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:17 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:18.700577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:18.701494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:18.708421 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:18.709012 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:18.710061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:18.710499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:18.809871 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a8e96ba5-e050-4a25-8bc9-39441be2665a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 36971 microversion: 2.20 time: 0.113176 Nov 22 23:08:18.814296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 545/1070] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:18 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 36971 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:19.067104 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:19.067699 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:19.074971 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.075428 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.076225 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.076665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.164614 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f88d1c4b-9fa7-4167-a92a-fc57c9581d95 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.101776 Nov 22 23:08:19.165256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 526/1071] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:19 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:19.232485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:19.233066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:19.235093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-10dc5bca-df1e-411f-acc7-750a994f918c req-5dbb8f40-5086-400e-93c5-c3a7351b5d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:19.236550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:08:19.236550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:08:19.240564 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.241298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.242207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.242727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.244851 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-10dc5bca-df1e-411f-acc7-750a994f918c req-5dbb8f40-5086-400e-93c5-c3a7351b5d93 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.245331 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-10dc5bca-df1e-411f-acc7-750a994f918c req-5dbb8f40-5086-400e-93c5-c3a7351b5d93 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.256694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-10dc5bca-df1e-411f-acc7-750a994f918c req-5dbb8f40-5086-400e-93c5-c3a7351b5d93 service nova] Creating event network-changed:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:08:19.261672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-10dc5bca-df1e-411f-acc7-750a994f918c req-5dbb8f40-5086-400e-93c5-c3a7351b5d93 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030541 Nov 22 23:08:19.263040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 527/1072] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:08:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:08:19.273565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:08:19.363375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b76878ae-7c18-4af6-8cb4-96f7b5c82183 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "DELETE /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 204 len: 0 microversion: 2.1 time: 0.134525 Nov 22 23:08:19.364210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 546/1073] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:08:19 2021] DELETE /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:08:19.374987 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:19.375694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:19.383832 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.384541 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.385550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.386137 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.632839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:19.641472 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-406be7ed-977c-4bb0-bf7f-bc4a51f2e33a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1567 microversion: 2.1 time: 0.272078 Nov 22 23:08:19.642274 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 528/1074] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:19 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:19.822429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:19.824195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:19.831118 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.831588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.832366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:19.832802 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:19.949279 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1917cc90-4a3b-4665-a181-db6780e6022f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 38204 microversion: 2.20 time: 0.130512 Nov 22 23:08:19.950786 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 547/1075] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:19 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 38204 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:20.176254 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:20.177986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:20.184420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:20.184871 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:20.185692 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:20.186132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:20.271892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8c59dca8-2902-4fdf-abbc-0623e233ae98 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.098993 Nov 22 23:08:20.272579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 529/1076] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:20 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:20.660188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:20.660885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:20.668457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:20.668902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:20.669699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:20.670129 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:20.801829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:20.809311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4511beb2-d929-409a-88ef-32670f42bf0c tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1448 microversion: 2.1 time: 0.153380 Nov 22 23:08:20.809908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 548/1077] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:20 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:20.962415 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:20.963317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:20.970235 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:20.970685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:20.971463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:20.971901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:21.086549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ad1e027e-3a12-4e79-bc43-bae46ead9256 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 38204 microversion: 2.20 time: 0.128771 Nov 22 23:08:21.087473 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 530/1078] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:20 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 38204 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:21.284223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:21.285143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:21.291798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:21.292251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:21.293033 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:21.293471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:21.425793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5e706086-8170-44d9-b319-3d1c8f205d07 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.145229 Nov 22 23:08:21.428874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 549/1079] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:21 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:21.828072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:21.829255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:21.836890 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:21.837395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:21.838248 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:21.838687 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:21.866467 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-476f0e65-6b37-433b-8ff5-8b7a3a850296 req-5926f009-da61-432a-bc43-4885fe38c024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818d0284-d432-40e7-8b2c-1f8b98bbf6ad", "name": "network-vif-deleted", "tag": "205659ce-e2b8-4823-8f63-d3f6c694a602"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:21.868953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:08:21.868953 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:08:21.878240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-476f0e65-6b37-433b-8ff5-8b7a3a850296 req-5926f009-da61-432a-bc43-4885fe38c024 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:21.879009 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-476f0e65-6b37-433b-8ff5-8b7a3a850296 req-5926f009-da61-432a-bc43-4885fe38c024 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:21.892120 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-476f0e65-6b37-433b-8ff5-8b7a3a850296 req-5926f009-da61-432a-bc43-4885fe38c024 service nova] Creating event network-vif-deleted:205659ce-e2b8-4823-8f63-d3f6c694a602 for instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad on hv-cinder-81883 Nov 22 23:08:21.898489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-476f0e65-6b37-433b-8ff5-8b7a3a850296 req-5926f009-da61-432a-bc43-4885fe38c024 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037907 Nov 22 23:08:21.899204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 550/1080] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:08:21.910308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93034034fa934b7486a203f4783835ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e29191d83b4af2b4c82ff4194343c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:21.918544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-32271f03-9473-4d01-8d2c-af62eb860456 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 200 len: 1381 microversion: 2.1 time: 0.095057 Nov 22 23:08:21.919104 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 531/1081] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:21 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 1381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:22.099948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:22.100821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:22.106918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:22.107363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:22.108126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:22.108659 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:22.197598 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dc715bef-6d90-4e67-9478-afee13c756d0 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 38204 microversion: 2.20 time: 0.102186 Nov 22 23:08:22.198287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 551/1082] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:22 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 38204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:22.437565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:22.438448 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:22.444787 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:22.445247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:22.446083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:22.446562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:22.566569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-32526521-a9c3-48d1-8b4d-3023bf35b61c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.132723 Nov 22 23:08:22.567223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 532/1083] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:22 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:22.937036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:22.937778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] [instance: 818d0284-d432-40e7-8b2c-1f8b98bbf6ad] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:22.944793 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:22.945241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:22.946037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:22.946514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:22.961570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] HTTP exception thrown: Instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad could not be found. Nov 22 23:08:22.962337 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Returning 404 to user: Instance 818d0284-d432-40e7-8b2c-1f8b98bbf6ad could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:08:22.963154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9d583105-e144-4fc0-8113-3f701c5593b3 tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad" status: 404 len: 111 microversion: 2.1 time: 0.030278 Nov 22 23:08:22.963702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 552/1084] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:22 2021] GET /compute/v2.1/servers/818d0284-d432-40e7-8b2c-1f8b98bbf6ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:08:23.211578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:23.212586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:23.219676 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:23.220163 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:23.220957 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:23.221403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:23.310583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-086f7c7a-d374-4f2b-9ab5-5900184e6d8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 38204 microversion: 2.20 time: 0.104068 Nov 22 23:08:23.312158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 533/1085] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:23 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 38204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:23.338512 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-020f22a4-6439-4e58-b66c-29d189e8af6a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] Calling method '.version_select at 0x7fefc969e5e0>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:23.361208 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-020f22a4-6439-4e58-b66c-29d189e8af6a tempest-TestShelveInstance-2861042 tempest-TestShelveInstance-2861042-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-998649441" status: 202 len: 0 microversion: 2.1 time: 0.026588 Nov 22 23:08:23.362847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 553/1086] 10.222.0.81 () {58 vars in 1250 bytes} [Mon Nov 22 23:08:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-998649441 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:23.579082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:23.579989 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:23.586792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:23.587239 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:23.588016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:23.588447 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:23.671377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-93e874a4-0508-4fea-a8b8-f141c22cce9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.096263 Nov 22 23:08:23.675216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 534/1087] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:23 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:24.323030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:24.323967 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:24.330683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:24.331140 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:24.331921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:24.332365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:24.427369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-d86592cc-2d57-49b2-9a62-89efcd943f0a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 200 len: 38345 microversion: 2.20 time: 0.108089 Nov 22 23:08:24.430870 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 554/1088] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:24 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 38345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:08:24.439825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:24.440410 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:24.447301 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:24.447997 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:24.448792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:24.449232 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:24.474848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6289b151-901f-4968-9159-b5ec9ac1a3de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/ips" status: 200 len: 152 microversion: 2.20 time: 0.038714 Nov 22 23:08:24.475527 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 535/1089] 10.222.0.81 () {60 vars in 1288 bytes} [Mon Nov 22 23:08:24 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:24.684033 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:24.685202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:24.692231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:24.693305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:24.698784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:24.699952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:24.815343 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6be54317-1686-4244-9e48-d43db0e59bc9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.135305 Nov 22 23:08:24.815993 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 555/1090] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:24 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:25.827499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:25.828784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:25.836431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:25.836962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:25.837884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:25.838326 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:25.931230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-10ddda93-fbc7-43f7-a066-4a0357cbf59a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.106805 Nov 22 23:08:25.932365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 536/1091] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:25 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:26.696914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:26.697662 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:26.704898 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:26.706042 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:26.707136 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:26.707585 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:26.735130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lazy-loading 'flavor' on Instance uuid 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:08:26.949576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:26.950815 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:26.959116 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:26.959636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:26.960510 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:26.960934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:27.023103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1ad1231c-f72a-4400-a44f-4615a5e63342 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 202 len: 0 microversion: 2.20 time: 0.330682 Nov 22 23:08:27.026695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 556/1092] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:08:26 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:08:27.034038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:27.034954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:27.044251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:27.044733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:27.046074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:27.046074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:27.063796 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-09462ee0-e1a7-4cea-9bd2-eb3da694c3d4 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.123962 Nov 22 23:08:27.064918 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 537/1093] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:26 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:27.182565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:27.190446 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:27.191956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:27.193106 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-220b4f3b-bf7c-4a8e-bc81-f48bd963b7ce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.164883 Nov 22 23:08:27.193696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 557/1094] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:27 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:28.076822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:28.078211 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:28.085972 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:28.086514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:28.087316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:28.087757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:28.181427 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c1ab056f-2fab-4a40-a412-26ca1a539dd6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.108413 Nov 22 23:08:28.182183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 538/1095] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:28 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:28.212198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:28.212790 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:28.218840 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:28.219295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:28.220076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:28.220524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:28.354480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:28.362497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:28.363991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:28.365571 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-828d1ac7-e5de-424a-abd1-bc8cc0aef76c tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.157206 Nov 22 23:08:28.366165 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 558/1096] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:28 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:29.193347 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:29.194949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:29.202224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:29.202680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:29.203476 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:29.203913 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:29.301460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-74e31415-4cce-474e-8a9f-2e2f0a2f3bce tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.112511 Nov 22 23:08:29.302927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 539/1097] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:29 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:29.383605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:29.384340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:29.390894 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:29.391346 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:29.392143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:29.392581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:29.546011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:29.555223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:29.556744 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:29.557965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e64b381a-cbda-4719-bbd8-ff9307d48d09 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.178406 Nov 22 23:08:29.558534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 559/1098] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:29 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:30.314676 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:30.315746 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:30.323589 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:30.324138 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:30.325063 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:30.325578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:30.416521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-73b61dc2-d90d-4774-8931-5135ca1cc8f9 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.105504 Nov 22 23:08:30.417096 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 540/1099] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:30 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:30.576112 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:30.576688 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:30.583057 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:30.583542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:30.584326 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:30.584759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:30.725249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:30.733201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:30.734718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:30.735865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5376dbb3-8cdf-4261-87c1-32a94b3e371a tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.163629 Nov 22 23:08:30.736454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 560/1100] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:30 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:31.428931 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:31.430077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:31.436925 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:31.437475 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:31.438296 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:31.438735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:31.537771 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5ef7a29f-bc60-4f4d-a0fc-edc419da61bb tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.113008 Nov 22 23:08:31.538656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 541/1101] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:31 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:31.754852 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:31.755633 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:31.761807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:31.762256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:31.763026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:31.763460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:32.039560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:32.047293 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:32.048751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:32.049961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4e560170-17e4-48f2-9e39-d477456e0881 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.298808 Nov 22 23:08:32.050513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 561/1102] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:31 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:32.549734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:32.550765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:32.558871 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:32.559520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:32.560708 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:32.561282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:33.068256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:33.068924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:33.075298 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:33.075772 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:33.076541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:33.076988 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:33.204024 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:33.212709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:33.214264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:33.215408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dc4a81f6-7104-4fcb-8bca-2a1fe701a0c1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.151194 Nov 22 23:08:33.215956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 562/1103] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:33 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:34.234751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:34.235394 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:34.242284 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:34.242733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:34.243518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:34.243951 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:34.382049 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:34.389892 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:34.391374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:34.392512 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b8fd209e-7256-469d-afff-50fcb8588c47 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.161506 Nov 22 23:08:34.393058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 563/1104] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:34 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:35.411295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:35.411971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:35.418258 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:35.418668 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:35.419385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:35.419819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:35.559384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:35.567098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:35.568599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:35.569788 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-534ee5c3-a5ab-4cc0-bbcf-d140950a4397 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.162511 Nov 22 23:08:35.570339 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 564/1105] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:35 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:35.711710 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-31e89be5-7851-4f8e-813f-0822be92aec7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 3.165958 Nov 22 23:08:35.712357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 542/1106] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:32 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 3168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:36.588753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:36.589336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:36.595651 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:36.596105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:36.596882 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:36.597313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:36.724882 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:36.726014 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:36.733937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:36.734255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:36.735053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:36.735492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:36.751938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:36.760342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:36.761947 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:36.763326 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1f7a5eea-c991-4d5d-bf71-e553814713f2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.178177 Nov 22 23:08:36.763702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 565/1107] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:36 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:36.828009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-33d049d3-ada5-4763-98b1-6f223507f270 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.108058 Nov 22 23:08:36.828835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 543/1108] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:36 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:37.781942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:37.782568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:37.789131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:37.789579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:37.790375 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:37.790804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:37.841171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:37.847455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:37.854324 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:37.854772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:37.855559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:37.859415 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:37.922143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:37.930590 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:37.932066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:37.933202 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-99f9c4f8-1499-4238-b676-5507e4a58a60 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.155015 Nov 22 23:08:37.933778 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 566/1109] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:37 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:37.995381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9a003075-7183-4e6c-bf3d-8ba09adf5825 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.158120 Nov 22 23:08:37.995977 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 544/1110] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:37 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:38.952007 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:38.952600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:38.959813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:38.960265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:38.961058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:38.961495 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:39.008070 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:39.009087 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:39.016144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:39.016570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:39.017369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:39.017855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:39.099667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:39.108415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:39.109164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b879b1f9-1561-4376-9135-1535f5ffd01c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.105800 Nov 22 23:08:39.109844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 545/1111] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:39 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:39.110254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:39.111606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b1d943eb-636d-4b53-b7b8-6c596c9154c2 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.163291 Nov 22 23:08:39.112155 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 567/1112] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:38 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:40.120875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:40.121905 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:40.128848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:40.129303 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:40.130108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:40.130601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:40.130709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:40.130814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:40.137000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:40.138661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:40.138661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:40.138661 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:40.219360 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f333e330-0c61-41f6-a44b-7b1fcfc0adc7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.102339 Nov 22 23:08:40.223233 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 546/1113] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:40 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:40.272399 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:40.280249 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:40.281783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:40.283199 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f4f1de6b-11cf-4a63-9cbc-7ee718c05454 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.156654 Nov 22 23:08:40.283750 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 568/1114] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:40 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:41.231938 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:41.232935 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:41.240109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:41.240562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:41.241357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:41.241837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:41.302315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:41.302908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:41.309545 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:41.310037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:41.310857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:41.311300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:41.339146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6c34f4dc-f9bc-4557-b0eb-971ff6ad6314 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.111086 Nov 22 23:08:41.339146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 547/1115] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:41 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:41.459187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:41.467005 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:41.468485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:41.469689 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-10dae4ad-2988-4dac-934d-3267c6c01060 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.171110 Nov 22 23:08:41.470269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 569/1116] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:41 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:42.352040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:42.353074 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:42.360303 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:42.360752 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:42.361537 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:42.361994 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:42.395349 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1492023450", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-283226992", "security_groups": [{"name": "tempest-secgroup-smoke-523553842"}], "block_device_mapping_v2": [{"uuid": "c76343d1-02a6-462e-93bf-bc85e7dc6d60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b01dbc7-4a1a-48b9-85b0-7d9ce9e6dcb9"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:42.455278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c9b199cc-7577-4702-8e52-b4ac7ada799e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.107110 Nov 22 23:08:42.456292 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 548/1117] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:42 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:42.487914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:42.488507 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:42.496155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:42.496610 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:42.497398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:42.497864 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:42.507498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] validate_networks() for [('0b01dbc7-4a1a-48b9-85b0-7d9ce9e6dcb9', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:08:42.736844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:42.745850 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:42.747396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:42.748949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a336bb3d-8ec4-4c94-b298-0f615a03bc81 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.264952 Nov 22 23:08:42.749634 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 549/1118] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:42 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:42.943322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:08:42.943779 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:08:42.944252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:08:42.944665 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:08:42.945077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:08:42.953923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:42.954394 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:42.955271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:42.955745 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:42.974902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for project 4371c64c75764f9c80faa90370720ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:08:42.978847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Getting quotas for user 4fe1833c77424a2d9ba3d33f1793c9f4 and project 4371c64c75764f9c80faa90370720ae5. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:08:43.033465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:08:43.035666 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c76343d1-02a6-462e-93bf-bc85e7dc6d60',volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:08:43.158477 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-909ae6a6-a544-46a1-bdf2-3637c0ceb07b tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.766813 Nov 22 23:08:43.159116 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 570/1119] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:08:42 2021] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 23:08:43.168879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a20e789c-0414-4888-b895-9037996c5c20 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:43.169492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a20e789c-0414-4888-b895-9037996c5c20 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:43.221829 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a20e789c-0414-4888-b895-9037996c5c20 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:43.231075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a20e789c-0414-4888-b895-9037996c5c20 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1094 microversion: 2.1 time: 0.065741 Nov 22 23:08:43.231652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 550/1120] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:43 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:43.467332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:43.468335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:43.475072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:43.475530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:43.476337 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:43.476794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:43.646850 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-09486c4d-6b12-4c2b-9c01-618b91d4e6a7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.182882 Nov 22 23:08:43.647501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 571/1121] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:43 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:43.768376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:43.769000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:43.776086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:43.776550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:43.777343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:43.777817 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:43.910449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:43.918587 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:43.920078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:43.921221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-68708fb8-5700-4579-99c8-d7099b090fcc tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1744 microversion: 2.20 time: 0.156638 Nov 22 23:08:43.921810 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 551/1122] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:43 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:44.250192 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:44.251274 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:44.259625 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:44.261215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:44.261463 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:44.261857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:44.335733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:44.346330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3f499557-cd52-4894-af8e-672476f04724 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1210 microversion: 2.1 time: 0.100695 Nov 22 23:08:44.347299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 572/1123] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:44 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:44.659107 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:44.660112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:44.667422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:44.668154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:44.668949 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:44.669417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:44.760835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ed60bfcb-cdaf-4be9-a36e-b34466796b9a tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.105516 Nov 22 23:08:44.761489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 552/1124] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:44 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:44.941111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:44.941807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:44.949130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:44.949593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:44.950435 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:44.950928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:45.163942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:45.172053 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:45.173570 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:45.174801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-64707bb9-06c5-4dfc-822d-c5b61de0c1ad tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1744 microversion: 2.20 time: 0.238356 Nov 22 23:08:45.175352 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 573/1125] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:44 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1744 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:45.366091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:45.366801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:45.374933 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:45.375316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:45.376253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:45.376873 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:45.611682 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:45.621195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c7847c0a-a7df-4ec0-91d2-28befc077a88 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.260086 Nov 22 23:08:45.625929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 553/1126] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:45 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:45.773322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:45.774701 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:45.783785 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:45.784694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:45.786221 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:45.787741 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:45.851126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-c851e695-1d24-4839-acd1-91771ab04426 req-6fb52cd1-9ee0-44bd-93ac-327273f6207f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd19414-dc5d-4baa-a697-71ce6ffbb944", "tag": "9a32d6b5-5043-43fb-98e4-95f79601a894"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:45.852637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:08:45.852637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:08:45.862802 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-c851e695-1d24-4839-acd1-91771ab04426 req-6fb52cd1-9ee0-44bd-93ac-327273f6207f service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:45.863308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-c851e695-1d24-4839-acd1-91771ab04426 req-6fb52cd1-9ee0-44bd-93ac-327273f6207f service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:45.876768 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-c851e695-1d24-4839-acd1-91771ab04426 req-6fb52cd1-9ee0-44bd-93ac-327273f6207f service nova] Creating event network-changed:9a32d6b5-5043-43fb-98e4-95f79601a894 for instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 on hv-cinder-81883 Nov 22 23:08:45.882497 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-c851e695-1d24-4839-acd1-91771ab04426 req-6fb52cd1-9ee0-44bd-93ac-327273f6207f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035498 Nov 22 23:08:45.883090 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 554/1127] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:08:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:08:45.892979 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-faa5663e-2644-4e53-b591-c555ca88387c tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 28650 microversion: 2.1 time: 0.123811 Nov 22 23:08:45.894088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 574/1128] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:45 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 28650 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:46.196804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:46.196804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:46.201899 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:46.202362 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:46.203164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:46.203605 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:46.403895 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:46.413110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:46.414661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:46.415825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-48f930bb-8bbf-4a5a-8e8a-03bb2cd87b9f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1744 microversion: 2.20 time: 0.226371 Nov 22 23:08:46.416613 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 555/1129] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:46 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1744 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:46.640072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:46.640886 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:46.647831 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:46.648272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:46.649047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:46.649476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:46.788215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:46.795563 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-88c6aeb5-83ba-4b9f-b431-2169ebd2ffbc tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.159451 Nov 22 23:08:46.796351 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 575/1130] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:46 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:08:46.905109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:46.906055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:46.913637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:46.914103 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:46.914885 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:46.915323 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:47.395157 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-e03bbc4d-7174-4a5b-8793-48abb9db81cf req-1584dc2e-15d3-448a-82d5-526def965740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "name": "network-vif-plugged", "status": "completed", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:47.396699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:08:47.396699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:08:47.404958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-e03bbc4d-7174-4a5b-8793-48abb9db81cf req-1584dc2e-15d3-448a-82d5-526def965740 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:47.405502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-e03bbc4d-7174-4a5b-8793-48abb9db81cf req-1584dc2e-15d3-448a-82d5-526def965740 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:47.419946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-e03bbc4d-7174-4a5b-8793-48abb9db81cf req-1584dc2e-15d3-448a-82d5-526def965740 service nova] Creating event network-vif-plugged:8da32319-51d1-4c63-adca-4c2685c82057 for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 on hv-cinder-81883 Nov 22 23:08:47.425569 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-e03bbc4d-7174-4a5b-8793-48abb9db81cf req-1584dc2e-15d3-448a-82d5-526def965740 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034024 Nov 22 23:08:47.426192 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 576/1131] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:08:47.433928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:47.434612 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:47.440551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:47.441002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:47.441811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:47.442348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:47.671047 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f1445f65-2bf3-4408-8a95-7a81cb42c92e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 29139 microversion: 2.1 time: 0.769352 Nov 22 23:08:47.675291 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 556/1132] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:46 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 29139 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:47.805310 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:47.813271 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:47.813456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:47.814038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:47.814792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:47.815956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a995642f-5dcb-4241-b046-6e2489c00365 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1744 microversion: 2.20 time: 0.385857 Nov 22 23:08:47.816510 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 577/1133] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:47 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1744 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:08:47.821665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:47.822115 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:47.822887 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:47.823322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:47.954694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:47.963454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2119783c-52b8-4e8a-ade7-a54b65b21d1f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.154000 Nov 22 23:08:47.964013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 557/1134] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:47 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:08:48.682915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:48.683938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:48.690243 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:48.690686 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:48.691451 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:48.692541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:48.793637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4ab9df99-b250-4c03-9512-cf7f57c0e9df tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 30973 microversion: 2.1 time: 0.114168 Nov 22 23:08:48.794278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 578/1135] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:48 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 30973 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:48.834951 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:48.835572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:48.842263 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:48.842719 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:48.843546 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:48.843994 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:48.982222 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:48.982901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:48.983825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:48.992038 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:48.992263 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:48.992944 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:48.993727 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:48.993873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:48.994223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:48.994914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-69831fe0-12ce-447b-8c91-9a8f997c9e42 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1744 microversion: 2.20 time: 0.164517 Nov 22 23:08:48.995475 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 558/1136] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:48 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:49.134223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:49.141670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bb409dbb-ce61-4358-aa62-b5ed3d5647fa tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.165084 Nov 22 23:08:49.148979 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 579/1137] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:48 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:08:49.806946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:49.807983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:49.814857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:49.815525 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:49.816350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:49.816854 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:49.952253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-62205673-9fdc-4f7f-8b64-32b72ed6e5b7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 32918 microversion: 2.1 time: 0.151486 Nov 22 23:08:49.953296 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 559/1138] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:49 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 32918 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:50.016493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:50.017186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:50.025109 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:50.025672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:50.026742 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:50.027277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:50.161168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:50.163252 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:50.171310 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:50.172333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:50.173675 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:50.174280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:50.183306 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:50.191223 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:50.193669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:50.195196 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-941b6ece-3a4a-4c0e-b342-66e24a1219f6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.182801 Nov 22 23:08:50.196387 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 580/1139] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:50 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:50.346484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:50.354825 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5f4b9c4b-1fce-49f7-a2f2-0c89c3ecd6e9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.199183 Nov 22 23:08:50.364158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 560/1140] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:50 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:08:50.969061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:50.970067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:50.977083 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:50.977537 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:50.978366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:50.978802 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:51.072617 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-21a338a1-43be-4324-98e8-94b9870617ad tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 33801 microversion: 2.1 time: 0.107021 Nov 22 23:08:51.074215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 581/1141] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:50 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 33801 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:51.215164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:51.216583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:51.223218 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:51.223763 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:51.224742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:51.225183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:51.374082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:51.375241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:51.381550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:51.393487 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:51.395054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:51.396212 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-39060da2-512e-4342-b917-6fab22382d40 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.184898 Nov 22 23:08:51.396765 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 561/1142] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:51 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:51.405838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:51.405838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:51.405838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:51.405838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:51.749765 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:51.758909 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-92d29564-78a6-472d-817e-0da2b557452d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.390633 Nov 22 23:08:51.759546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 582/1143] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:51 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:52.087357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:52.088322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:52.095343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:52.095788 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:52.096586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:52.097016 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:52.216766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-eb83873b-2fe0-4d3d-891b-2f818fa23670 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 35035 microversion: 2.1 time: 0.133666 Nov 22 23:08:52.217681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 562/1144] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:52 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 35035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:52.417409 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:52.418798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:52.425566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:52.426229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:52.427728 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:52.428254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:52.601915 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:52.610827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:52.612838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:52.614918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fb0fc7f9-bdc5-4cfa-9f1d-2b7a361fe3bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.201273 Nov 22 23:08:52.625781 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 583/1145] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:52 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:52.776422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:52.777224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:52.786544 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:52.787568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:52.788637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:52.789412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:53.006176 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:53.025238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5c0c9f70-5999-4217-8f21-cb0c55b44cb4 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.251793 Nov 22 23:08:53.026095 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 563/1146] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:52 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:53.228959 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:53.230201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:53.238596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:53.240122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:53.240943 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:53.241502 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:53.355596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-15bcad5e-133b-4885-b4c4-28098be77e70 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 36139 microversion: 2.1 time: 0.130295 Nov 22 23:08:53.356261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 584/1147] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:53 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 36139 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:53.633810 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:53.634455 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:53.640650 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:53.641335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:53.642151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:53.642750 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:53.809752 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:53.824971 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:53.828189 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:53.830046 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-02a6d9fa-5485-4169-a905-08bc803f6b90 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.200237 Nov 22 23:08:53.831239 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 564/1148] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:53 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:54.044110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:54.047569 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:54.065079 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:54.065573 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:54.066583 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:54.067050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:54.313753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:54.322315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ef6663ba-630d-463c-8046-37634c12d0da tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.282641 Nov 22 23:08:54.324126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 585/1149] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:54 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:54.373158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:54.374822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:54.384159 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:54.384764 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:54.385632 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:54.386135 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:54.508777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5fb1b261-50ee-4e77-aa00-43349df7d21e tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 37533 microversion: 2.1 time: 0.142007 Nov 22 23:08:54.509409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 565/1150] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:54 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 37533 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:54.853588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:54.854305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:54.865099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:54.865572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:54.867928 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:54.868423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:55.042098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:55.051066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:55.057237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:55.058642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8970f63b-b3ee-4305-a480-140e10ee1596 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.209539 Nov 22 23:08:55.069827 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 586/1151] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:54 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:55.341649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:55.342357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:55.350968 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:55.352509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:55.353418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:55.353889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:55.521561 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:55.522525 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:55.527903 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:55.531785 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:55.532246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:55.533301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:55.534428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:55.546581 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-64b66734-b967-4176-a6af-f779491a3d75 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.208807 Nov 22 23:08:55.558637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 566/1152] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:55 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:55.666961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5986ecfb-a8bb-49e1-92ec-65d5d117e061 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 38181 microversion: 2.1 time: 0.148961 Nov 22 23:08:55.668583 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 587/1153] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:55 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 38181 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:56.078145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:56.078758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:56.085752 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:56.086204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:56.086996 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:56.087434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:56.264734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:56.275488 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:56.277393 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:56.278988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-79544846-991f-4a2f-979b-c35e8b3751de tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.204621 Nov 22 23:08:56.279609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 567/1154] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:56 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:56.566627 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:56.567781 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:56.574513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:56.575374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:56.576423 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:56.576836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:56.680813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:56.681832 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:56.693664 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:56.694477 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:56.695501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:56.696112 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:56.741917 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:56.750168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-be19927b-ca34-40eb-906e-db60f4dae6a7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.187441 Nov 22 23:08:56.761060 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 588/1155] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:56 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:56.799029 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ac66eedf-efad-4a8a-9cb8-9fa9ee538645 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 38181 microversion: 2.1 time: 0.122215 Nov 22 23:08:56.800698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 568/1156] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:56 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 38181 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 23:08:57.300720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:57.302381 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:57.313878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:57.314361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:57.315173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:57.315621 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:57.525804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:57.542490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:57.544018 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:57.545309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-65fad6e1-f96f-45a6-bf7c-1fae3353a5b1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.248567 Nov 22 23:08:57.558314 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 589/1157] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:57 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:57.767917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:57.768654 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:57.780018 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:57.780881 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:57.782053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:57.782313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:57.813284 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:57.814187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:57.822153 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:57.822693 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:57.823579 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:57.824078 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:57.964606 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-375f518e-f254-4efa-9049-42a627d1a2d8 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 38181 microversion: 2.1 time: 0.155029 Nov 22 23:08:57.966134 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 590/1158] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:57 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 38181 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:57.991358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:57.999630 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f4230716-1790-4b55-8211-25b7e67b2b66 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.235620 Nov 22 23:08:58.009792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 569/1159] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:57 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:08:58.565267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:58.567540 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:58.574671 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:58.575123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:58.575903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:58.576338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:58.712435 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:58.720137 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:58.721645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:58.722956 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-74827848-699c-407c-b5b1-c3ba9f24b067 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1739 microversion: 2.20 time: 0.161880 Nov 22 23:08:58.723353 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 591/1160] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:58 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:08:58.976571 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:08:58.977492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:58.984099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:58.984547 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:58.985328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:58.985814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:59.016053 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:59.016695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:59.023104 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:59.023550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:59.024322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:59.024754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:59.145753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0cc48b0f-94eb-4f02-bee4-5c6bdb44605f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action" status: 200 len: 38310 microversion: 2.1 time: 0.172496 Nov 22 23:08:59.146734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 570/1161] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:08:58 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/action => generated 38310 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:08:59.157011 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:59.157902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:59.165846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:08:59.166483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:59.166956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:59.167874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:59.168367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:59.173720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dd54b3b7-fdd1-404c-9d88-dbcbb8ea96b7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.161146 Nov 22 23:08:59.174631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 592/1162] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:08:59 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:08:59.194782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9391413a-502f-4db1-afba-7d62d3a0bfd2 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/ips" status: 200 len: 145 microversion: 2.1 time: 0.041816 Nov 22 23:08:59.195398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 571/1163] 10.222.0.81 () {58 vars in 1247 bytes} [Mon Nov 22 23:08:59 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:08:59.895824 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:08:59.896431 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:08:59.902386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:59.902839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:08:59.903623 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:08:59.904059 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:00.120550 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:00.128408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:00.130878 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:00.132058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-59a73515-694a-4a05-82bf-600bb5297919 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1721 microversion: 2.20 time: 0.395481 Nov 22 23:09:00.132624 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 593/1164] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:08:59 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:00.192219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:00.193162 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:00.199875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:00.200350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:00.201198 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:00.201659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:00.358592 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:00.366380 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-072e4956-06de-47d2-8fab-1fba3b2ec4e7 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.178687 Nov 22 23:09:00.366965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 572/1165] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:00 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:00.510560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d49faca6-7881-4d9e-a534-a3742ad771f6"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:00.511647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:00.518019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:00.518473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:00.519245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:00.519697 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:00.772588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7e5bf03b-12bb-40a6-9b12-5a8e52c57ed6 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265403 Nov 22 23:09:00.773198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 594/1166] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:09:00 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:01.150449 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:01.151077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:01.157744 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:01.158197 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:01.159027 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:01.159415 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:01.299188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:01.307463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:01.308937 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:01.310156 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4aff2a30-190e-4fdb-8dc8-78f3429c4cb5 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1721 microversion: 2.20 time: 0.163463 Nov 22 23:09:01.310711 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 573/1167] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:01 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:01.384325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:01.385097 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:01.391638 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:01.392082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:01.392862 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:01.393325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:01.506044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-33d049c7-2c93-4887-8447-277056a5f9d2 req-64661830-a1bc-47cb-8f3e-c9aef479e529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd19414-dc5d-4baa-a697-71ce6ffbb944", "name": "network-vif-plugged", "status": "completed", "tag": "9a32d6b5-5043-43fb-98e4-95f79601a894"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:01.507726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:09:01.507726 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:09:01.515760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-33d049c7-2c93-4887-8447-277056a5f9d2 req-64661830-a1bc-47cb-8f3e-c9aef479e529 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:01.516214 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-33d049c7-2c93-4887-8447-277056a5f9d2 req-64661830-a1bc-47cb-8f3e-c9aef479e529 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:01.529265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-33d049c7-2c93-4887-8447-277056a5f9d2 req-64661830-a1bc-47cb-8f3e-c9aef479e529 service nova] Creating event network-vif-plugged:9a32d6b5-5043-43fb-98e4-95f79601a894 for instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 on hv-cinder-81883 Nov 22 23:09:01.534484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-33d049c7-2c93-4887-8447-277056a5f9d2 req-64661830-a1bc-47cb-8f3e-c9aef479e529 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Nov 22 23:09:01.535081 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 574/1168] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:09:01.543774 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:01.552262 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cb07d1ef-a3d5-4a2f-b278-cd3b81ab3bc5 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.172175 Nov 22 23:09:01.553060 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 595/1169] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:01 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:02.330577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:02.331265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:02.338098 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:02.338542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:02.339315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:02.339747 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:02.472651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:02.480734 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:02.482286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:02.483876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c6848e5f-df1b-48f2-b84e-3a61b63a2272 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1721 microversion: 2.20 time: 0.157925 Nov 22 23:09:02.484645 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 575/1170] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:02 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:09:02.568782 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:02.569428 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:02.576300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:02.576749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:02.577810 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:02.578307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:02.730892 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:02.738949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-bfcc6425-b45f-48b7-945f-ec80c6715205 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1265 microversion: 2.1 time: 0.174392 Nov 22 23:09:02.739521 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 596/1171] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:02 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:09:03.502735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:03.503387 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:03.511257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.511928 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.512761 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.513167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.555751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-306f999d-e191-48d3-999c-a747190a7f9c req-7e276d7a-2770-447b-8dcc-6913d4cd7d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "name": "network-vif-unplugged", "status": "completed", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:03.557796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:09:03.557796 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:09:03.565016 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-306f999d-e191-48d3-999c-a747190a7f9c req-7e276d7a-2770-447b-8dcc-6913d4cd7d93 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.565457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-306f999d-e191-48d3-999c-a747190a7f9c req-7e276d7a-2770-447b-8dcc-6913d4cd7d93 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.577394 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.compute.server_external_events [req-306f999d-e191-48d3-999c-a747190a7f9c req-7e276d7a-2770-447b-8dcc-6913d4cd7d93 service nova] Unable to find a host for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21. Dropping event network-vif-unplugged {{(pid=116339) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 22 23:09:03.578315 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-306f999d-e191-48d3-999c-a747190a7f9c req-7e276d7a-2770-447b-8dcc-6913d4cd7d93 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026383 Nov 22 23:09:03.579328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 597/1172] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 22 23:09:03.662777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:03.671511 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:03.673007 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:03.674359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6d582770-a5b5-4bb6-82d4-d580a30be783 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1664 microversion: 2.20 time: 0.175327 Nov 22 23:09:03.675412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 576/1173] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:03 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:03.694788 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4326fa05-5095-40f8-8cc1-206c130abfed"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:03.695914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:03.702547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.702999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.703829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.704336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.755706 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:03.756322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:03.762376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.762819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.763647 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.764223 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.911174 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:03.919200 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-639a9bd0-81c2-46d7-b8a0-9b0e4c01bc00 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1452 microversion: 2.1 time: 0.167134 Nov 22 23:09:03.919795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 577/1174] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:03 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:09:03.937819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:03.938392 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:03.945280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.945790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:03.946586 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:03.947026 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.030413 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-81cc2d78-9167-406e-b7b1-12c76ddd9096 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339636 Nov 22 23:09:04.031338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 598/1175] 10.222.0.81 () {62 vars in 1363 bytes} [Mon Nov 22 23:09:03 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-volume_attachments => generated 188 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 23:09:04.110041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:04.117924 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ca1b2181-af9e-4691-aad6-1a1ae97e7ef8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1452 microversion: 2.1 time: 0.183909 Nov 22 23:09:04.118735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 578/1176] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:03 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:04.143404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:04.144004 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:04.152239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:04.152763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.153842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:04.154408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.411397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-29c5f723-00ba-49da-a040-7587a7a41ce9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-volume_attachments/4326fa05-5095-40f8-8cc1-206c130abfed" status: 202 len: 0 microversion: 2.20 time: 0.271557 Nov 22 23:09:04.412588 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 599/1177] 10.222.0.81 () {60 vars in 1456 bytes} [Mon Nov 22 23:09:04 2021] DELETE /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-volume_attachments/4326fa05-5095-40f8-8cc1-206c130abfed => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:09:04.475168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:04.475852 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:04.483082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:04.483539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.484330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:04.484954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.588732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c4a3ddb3-d150-4860-a166-08cb0135807b tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action" status: 202 len: 0 microversion: 2.20 time: 0.117120 Nov 22 23:09:04.589395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 579/1178] 10.222.0.81 () {62 vars in 1318 bytes} [Mon Nov 22 23:09:04 2021] POST /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:09:04.599440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:04.600098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:04.612147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:04.612753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.614416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:04.614845 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:04.822790 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:04.835297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:04.836813 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:04.838044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-eb42a813-4268-4e07-b80c-b447d92433aa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1672 microversion: 2.20 time: 0.244040 Nov 22 23:09:04.838619 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 600/1179] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:04 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:09:05.860466 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:05.861099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:05.870278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:05.870741 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:05.871570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:05.872015 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:06.205059 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:06.217422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:06.218959 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:06.220192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-90178b40-6de6-4c12-96fd-d76dc29a66f4 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.364966 Nov 22 23:09:06.221085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 580/1180] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:05 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:06.743448 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-f71fcfdb-0249-428f-8275-b960ae5fcc11 req-4b29f35b-0f10-44f2-8462-09133605d38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd19414-dc5d-4baa-a697-71ce6ffbb944", "tag": "9a32d6b5-5043-43fb-98e4-95f79601a894"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:06.744923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:09:06.744923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:09:06.761051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f71fcfdb-0249-428f-8275-b960ae5fcc11 req-4b29f35b-0f10-44f2-8462-09133605d38d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:06.761518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-f71fcfdb-0249-428f-8275-b960ae5fcc11 req-4b29f35b-0f10-44f2-8462-09133605d38d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:06.777011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-f71fcfdb-0249-428f-8275-b960ae5fcc11 req-4b29f35b-0f10-44f2-8462-09133605d38d service nova] Creating event network-changed:9a32d6b5-5043-43fb-98e4-95f79601a894 for instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 on hv-cinder-81883 Nov 22 23:09:06.783334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-f71fcfdb-0249-428f-8275-b960ae5fcc11 req-4b29f35b-0f10-44f2-8462-09133605d38d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042807 Nov 22 23:09:06.784903 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 601/1181] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:09:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:07.247181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:07.248879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:07.265409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:07.265894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:07.266712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:07.267149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:07.497422 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:07.509979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:07.515550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:07.516498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5861517f-2fe6-4071-8414-e231038e052f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.274854 Nov 22 23:09:07.517383 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 581/1182] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:07 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:08.536608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:08.537296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:08.547128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:08.547918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:08.548986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:08.549669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:08.686596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:08.694483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:08.695948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:08.697086 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-450925ba-c0ef-4d56-a660-bd1800d725ec tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.165925 Nov 22 23:09:08.697667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 602/1183] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:08 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:09.716663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:09.717304 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:09.727405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:09.728038 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:09.729113 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:09.729554 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:09.870183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:09.879939 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:09.881440 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:09.882672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-175c604e-ef30-4655-b551-c049f8a683b9 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.170573 Nov 22 23:09:09.883228 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 582/1184] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:09 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:10.902837 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:10.903483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:10.910615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:10.911145 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:10.911954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:10.912414 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:11.054991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:11.062691 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:11.064161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:11.065297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f717a1f9-d424-4a3f-9b32-e6b1598aec8f tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.166437 Nov 22 23:09:11.065886 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 603/1185] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:10 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:12.087365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:12.088000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:12.095374 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:12.096459 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:12.097683 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:12.098774 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:12.234369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:12.242888 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:12.244386 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:12.245579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d4e54723-595e-425d-9a85-cc24fbd10360 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.165073 Nov 22 23:09:12.246394 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 583/1186] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:12 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:13.266256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:13.267799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:13.277127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:13.278088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:13.279270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:13.279986 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:13.416857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:13.426746 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:13.428554 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:13.429776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3ed9abbe-f31b-493a-8712-42d3c49a1778 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.168927 Nov 22 23:09:13.439219 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 604/1187] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:13 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:14.448938 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:14.449753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:14.456369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:14.456855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:14.457782 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:14.458233 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:14.595463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:14.604856 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:14.606423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:14.607646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ef91477f-d1e9-49d4-9bc8-0385f46696bf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.162602 Nov 22 23:09:14.608230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 584/1188] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:14 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:15.626085 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:15.626696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:15.634283 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:15.634741 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:15.635568 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:15.636010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:15.814108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:15.822552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:15.824412 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:15.825581 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-19732952-4e8c-44d5-ad00-c83add57e8f1 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.203135 Nov 22 23:09:15.826168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 605/1189] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:15 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:16.846224 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:16.846868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:16.853483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:16.853976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:16.854772 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:16.855213 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:16.986343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:16.996520 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:16.997681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:16.998871 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e8109f53-4909-411c-ab67-00742b8ca833 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.156517 Nov 22 23:09:16.999630 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 585/1190] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:16 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:18.019002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:18.020335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:18.026851 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:18.027299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:18.028078 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:18.028513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:18.166070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:18.174148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:18.175636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:18.177283 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1d6a4ab8-af5e-4a34-89f1-a01111bbe65d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.162082 Nov 22 23:09:18.177874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 606/1191] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:18 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:19.195613 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:19.196206 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:19.202465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:19.202916 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:19.203698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:19.204139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:19.342780 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:19.350631 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:19.352268 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:19.353526 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-33d6bdf9-bfc0-4385-86e0-57619fbbe885 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.161734 Nov 22 23:09:19.354099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 586/1192] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:19 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:20.372030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:20.372695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:20.378946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:20.379545 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:20.380309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:20.380737 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:20.523011 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:20.530849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:20.532584 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:20.533749 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3185d92c-7b79-44a8-b9f2-4fd3141faea8 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.165446 Nov 22 23:09:20.534305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 607/1193] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:20 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:21.551241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:21.551879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:21.558339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:21.558777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:21.559562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:21.560000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:21.688842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:21.697162 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:21.698743 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:21.699894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9f184e2d-6769-4c96-b06f-ea66ccc6f343 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.152566 Nov 22 23:09:21.700452 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 587/1194] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:21 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:22.717775 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:22.718409 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:22.725162 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:22.725704 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:22.726527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:22.726972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:22.855241 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:22.863529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:22.865090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:22.866278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5750e0ac-5f56-4be0-8858-6ff3e58f2abe tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.152317 Nov 22 23:09:22.866844 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 608/1195] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:22 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:23.884300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:23.884908 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:23.891342 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:23.891797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:23.892585 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:23.893021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:24.027240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:24.035244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:24.036733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:24.037901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2b618976-2353-4ab9-ad10-d7cd75e94c37 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.157316 Nov 22 23:09:24.038458 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 588/1196] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:23 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:09:24.072026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:24.073019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:24.079329 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:24.079781 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:24.080562 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:24.081006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:24.112429 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9b509185-84d0-42bf-9170-fb7a277a75b1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Nov 22 23:09:24.112998 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 609/1197] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:09:24 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:24.122807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:24.123239 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:24.129804 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:24.130247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:24.131036 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:24.131474 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:24.160166 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-17db1504-5be1-4789-b2e1-e816828a9c04 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/d49faca6-7881-4d9e-a534-a3742ad771f6" status: 200 len: 194 microversion: 2.1 time: 0.041270 Nov 22 23:09:24.160844 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 589/1198] 10.222.0.81 () {58 vars in 1412 bytes} [Mon Nov 22 23:09:24 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/d49faca6-7881-4d9e-a534-a3742ad771f6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:25.055576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:25.056182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:25.062267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:25.062718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:25.063486 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:25.063931 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:25.194912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:25.202617 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:25.204094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:25.205246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e69f5362-c910-4213-9006-8f86087508c7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.153373 Nov 22 23:09:25.205825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 610/1199] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:25 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:25.466819 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32de01b4-e929-4630-9432-8a1e640c2b9b"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:25.467936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:25.475013 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:25.475478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:25.476260 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:25.476704 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:25.733171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-28af669e-44e1-41a0-9fff-f8830fe16dae tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269703 Nov 22 23:09:25.733814 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 590/1200] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:09:25 2021] POST /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:26.224284 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:26.224846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:26.231297 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:26.231682 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:26.232463 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:26.232899 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:26.366933 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:26.374718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:26.376193 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:26.377336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5d65e725-f661-41af-b8a3-491b7dddb782 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.156991 Nov 22 23:09:26.377942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 611/1201] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:26 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:27.397562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:27.398317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:27.404857 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:27.405312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:27.406128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:27.406574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:27.539806 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:27.547580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:27.549075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:27.550299 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3cfc79ce-571a-4dd6-a7e3-4330f7f98874 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.157425 Nov 22 23:09:27.551019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 591/1202] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:27 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:28.568147 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:28.568746 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:28.575265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:28.575712 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:28.576476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:28.576902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:28.705869 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:28.714062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:28.715551 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:28.716696 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1831121c-3e82-435f-af0b-b49c17045faa tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.152305 Nov 22 23:09:28.717255 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 612/1203] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:28 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:29.632095 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-ea86068c-1ed5-4c2b-b148-0e2dcf7395b4 req-4706de39-341f-4835-a667-7457d4535240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "name": "network-vif-plugged", "status": "completed", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:29.633755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:09:29.633755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:09:29.641033 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-ea86068c-1ed5-4c2b-b148-0e2dcf7395b4 req-4706de39-341f-4835-a667-7457d4535240 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:29.641561 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-ea86068c-1ed5-4c2b-b148-0e2dcf7395b4 req-4706de39-341f-4835-a667-7457d4535240 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:29.652482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-ea86068c-1ed5-4c2b-b148-0e2dcf7395b4 req-4706de39-341f-4835-a667-7457d4535240 service nova] Creating event network-vif-plugged:8da32319-51d1-4c63-adca-4c2685c82057 for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 on hv-cinder-81883 Nov 22 23:09:29.657666 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-ea86068c-1ed5-4c2b-b148-0e2dcf7395b4 req-4706de39-341f-4835-a667-7457d4535240 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029539 Nov 22 23:09:29.658256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 592/1204] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:09:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:29.734941 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:29.735530 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:29.742113 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:29.742556 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:29.743330 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:29.743763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:29.884759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:29.892866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:29.895158 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:29.896721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9c98fa16-7fe5-4577-b523-2e9128f02081 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.165558 Nov 22 23:09:29.897340 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 613/1205] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:29 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:30.916402 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:30.917132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:30.923377 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:30.923830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:30.924609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:30.925049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:31.061874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:31.069685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:31.071183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:31.072327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a10a9287-0426-4da7-ab35-a54f22f2bfaf tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.160549 Nov 22 23:09:31.072876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 593/1206] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:30 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:32.090940 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:32.091566 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:32.099123 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:32.099981 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:32.100967 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:32.101479 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:32.235280 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:32.244157 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:32.245669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:32.246855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-53e864b0-5906-401b-9c0e-d469307ef741 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1730 microversion: 2.20 time: 0.160432 Nov 22 23:09:32.247483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 614/1207] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:32 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:33.214279 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:33.215209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:33.221516 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.222003 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.223257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.223704 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.258156 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-83beb1ed-38e7-4f3f-b4f2-f8c58aca7f88 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047247 Nov 22 23:09:33.259106 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 594/1208] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:09:33 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:33.265030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:33.265675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:33.272040 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.272482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.273251 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.273711 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.407420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:33.416090 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:33.417583 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:33.418762 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e889adef-f127-4998-924f-b50594ac713d tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1717 microversion: 2.20 time: 0.157373 Nov 22 23:09:33.419334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 615/1209] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:09:33 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:09:33.478905 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:33.479403 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:33.485269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.485757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.486542 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.486986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.514868 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d5d70f04-f463-4181-9345-e4e9f13b87f0 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/d49faca6-7881-4d9e-a534-a3742ad771f6" status: 200 len: 194 microversion: 2.1 time: 0.039697 Nov 22 23:09:33.515441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 595/1210] 10.222.0.81 () {58 vars in 1412 bytes} [Mon Nov 22 23:09:33 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/d49faca6-7881-4d9e-a534-a3742ad771f6 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:33.525207 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:33.525826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:33.531621 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.532341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.533114 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:33.533552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:33.610848 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lazy-loading 'services' on Instance uuid e01eeecd-0971-4ec1-a627-0446024134fb {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:09:33.722206 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-aa67aeb5-6094-4c09-8812-3a8b57956303 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/d49faca6-7881-4d9e-a534-a3742ad771f6" status: 202 len: 0 microversion: 2.1 time: 0.200295 Nov 22 23:09:33.722792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 616/1211] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:09:33 2021] DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/d49faca6-7881-4d9e-a534-a3742ad771f6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:09:35.880429 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:35.880954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:35.887209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:35.887659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:35.888506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:35.888947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:35.917337 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bf072d5e-9169-4e04-bcb5-c0fc46ef8209 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/32de01b4-e929-4630-9432-8a1e640c2b9b" status: 200 len: 194 microversion: 2.1 time: 0.041307 Nov 22 23:09:35.917948 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 596/1212] 10.222.0.81 () {58 vars in 1412 bytes} [Mon Nov 22 23:09:35 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/32de01b4-e929-4630-9432-8a1e640c2b9b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:35.930805 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:35.931621 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:35.937667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:35.938116 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:35.938879 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:35.939309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:36.015538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lazy-loading 'services' on Instance uuid e01eeecd-0971-4ec1-a627-0446024134fb {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:09:36.082817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f0baaabf-c417-4148-8a0c-0a40ec4a13da tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/32de01b4-e929-4630-9432-8a1e640c2b9b" status: 202 len: 0 microversion: 2.1 time: 0.157652 Nov 22 23:09:36.082817 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 617/1213] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:09:35 2021] DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments/32de01b4-e929-4630-9432-8a1e640c2b9b => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:09:37.233709 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:37.234646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:37.241399 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.241886 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.242675 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.243110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.271582 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a71872c3-8c82-47eb-840b-7931173e6c6b tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041618 Nov 22 23:09:37.272259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 597/1214] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:09:37 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:09:37.372456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:37.373522 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:37.379849 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.380290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.381062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.381498 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.410657 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9fd3e339-85be-4ded-993e-152290a36b32 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042726 Nov 22 23:09:37.411204 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 618/1215] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:09:37 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:09:37.465111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:37.465633 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:37.471784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.473019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.473839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.474281 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.498595 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:09:37.571728 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c7b57665-22e2-4897-803c-0f9ae1c22bf5 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 204 len: 0 microversion: 2.1 time: 0.109829 Nov 22 23:09:37.572244 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 598/1216] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:09:37 2021] DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:09:37.580321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:37.580942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:37.587235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.587685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.588814 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:37.588944 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:37.719961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:37.728010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-de0b52f6-71ee-4022-af8b-6dd32756f3bf tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1672 microversion: 2.1 time: 0.151272 Nov 22 23:09:37.728589 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 619/1217] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:37 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:38.745247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:38.745925 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:38.752255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:38.752711 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:38.753583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:38.754125 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:38.886110 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:38.893434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f9bc2930-ba04-4a80-8eb2-61f57d8a8e26 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1672 microversion: 2.1 time: 0.152270 Nov 22 23:09:38.894820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 599/1218] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:38 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:39.911897 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:39.912499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:39.919672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:39.920121 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:39.920900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:39.921334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:40.125514 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:40.133341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-44c52bd7-6a50-4932-8700-4b8e466d1934 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1672 microversion: 2.1 time: 0.225172 Nov 22 23:09:40.133952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 620/1219] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:39 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:40.843180 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-13c1b564-716e-4d92-8e37-497c7bd4f5ef req-d8f7720e-82c4-4fa2-967e-84b08a0dc558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01eeecd-0971-4ec1-a627-0446024134fb", "name": "network-vif-deleted", "tag": "ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:40.851777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:09:40.851777 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:09:40.859317 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-13c1b564-716e-4d92-8e37-497c7bd4f5ef req-d8f7720e-82c4-4fa2-967e-84b08a0dc558 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:40.859766 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-13c1b564-716e-4d92-8e37-497c7bd4f5ef req-d8f7720e-82c4-4fa2-967e-84b08a0dc558 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:40.876130 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-13c1b564-716e-4d92-8e37-497c7bd4f5ef req-d8f7720e-82c4-4fa2-967e-84b08a0dc558 service nova] Creating event network-vif-deleted:ed7fa54c-1ccb-4873-8faf-e69c13c3c3f0 for instance e01eeecd-0971-4ec1-a627-0446024134fb on hv-cinder-81883 Nov 22 23:09:40.881744 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-13c1b564-716e-4d92-8e37-497c7bd4f5ef req-d8f7720e-82c4-4fa2-967e-84b08a0dc558 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042193 Nov 22 23:09:40.882346 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 600/1220] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:09:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:41.150991 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:41.151527 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:41.159676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:41.160150 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:41.160977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:41.161414 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:41.194006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:41.194347 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:41.194790 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lazy-loading 'fault' on Instance uuid e01eeecd-0971-4ec1-a627-0446024134fb {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:09:41.236393 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b25dcec4c1f4047ae84ce3572ec4da1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525897e49c34ebb9215d460e1ad237d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:41.244715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c474e884-cf53-47bc-b980-71344e12d1d7 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 200 len: 1327 microversion: 2.1 time: 0.097361 Nov 22 23:09:41.246028 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 621/1221] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:41 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:42.264179 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:42.264779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:42.272142 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:42.272596 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:42.273381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:42.273850 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:42.287818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] HTTP exception thrown: Instance e01eeecd-0971-4ec1-a627-0446024134fb could not be found. Nov 22 23:09:42.288404 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Returning 404 to user: Instance e01eeecd-0971-4ec1-a627-0446024134fb could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:09:42.289221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-216f8d04-55fe-465e-881b-8c84609524f1 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 404 len: 111 microversion: 2.1 time: 0.029693 Nov 22 23:09:42.289818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 601/1222] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:42 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:09:42.297847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8bc0b5ca-b808-4b63-9997-db44332ae22d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '.version_select at 0x7fefc981ec10>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:42.320647 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8bc0b5ca-b808-4b63-9997-db44332ae22d tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354799337" status: 202 len: 0 microversion: 2.1 time: 0.026335 Nov 22 23:09:42.321234 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 622/1223] 10.222.0.81 () {58 vars in 1220 bytes} [Mon Nov 22 23:09:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354799337 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:09:45.208559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:45.209072 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:45.216863 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:45.217320 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:45.218153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:45.218606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:45.231613 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] HTTP exception thrown: Instance e01eeecd-0971-4ec1-a627-0446024134fb could not be found. Nov 22 23:09:45.232219 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Returning 404 to user: Instance e01eeecd-0971-4ec1-a627-0446024134fb could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:09:45.233078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c4f11b22-4e33-422e-a78e-2f2938212714 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 404 len: 111 microversion: 2.1 time: 0.028541 Nov 22 23:09:45.233660 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 602/1224] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:09:45 2021] DELETE /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:09:45.242464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:45.243096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: e01eeecd-0971-4ec1-a627-0446024134fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:45.248989 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:45.249430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:45.250226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:45.250676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:45.264416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] HTTP exception thrown: Instance e01eeecd-0971-4ec1-a627-0446024134fb could not be found. Nov 22 23:09:45.264985 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Returning 404 to user: Instance e01eeecd-0971-4ec1-a627-0446024134fb could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:09:45.265846 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-9336914b-f2a2-48a8-9eae-bb49bfe75310 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb" status: 404 len: 111 microversion: 2.1 time: 0.028136 Nov 22 23:09:45.266369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 623/1225] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:45 2021] GET /compute/v2.1/servers/e01eeecd-0971-4ec1-a627-0446024134fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:09:46.392715 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:46.393248 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:46.400336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:46.400788 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:46.401570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:46.402040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:46.415753 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] HTTP exception thrown: Instance ce09954f-3efe-4542-9eb8-c1be3bc21549 could not be found. Nov 22 23:09:46.416335 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Returning 404 to user: Instance ce09954f-3efe-4542-9eb8-c1be3bc21549 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:09:46.417151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b980f754-7cfc-409b-9f89-a834f82a9a03 tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 404 len: 111 microversion: 2.1 time: 0.028137 Nov 22 23:09:46.417838 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 603/1226] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:09:46 2021] DELETE /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:09:46.425802 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:46.426422 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] [instance: ce09954f-3efe-4542-9eb8-c1be3bc21549] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:46.432636 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:46.433092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:46.433905 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:46.434349 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:46.447860 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] HTTP exception thrown: Instance ce09954f-3efe-4542-9eb8-c1be3bc21549 could not be found. Nov 22 23:09:46.448441 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] Returning 404 to user: Instance ce09954f-3efe-4542-9eb8-c1be3bc21549 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:09:46.449287 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-12fcf4af-454f-45d7-b74f-faccfef2f78f tempest-AttachVolumeTestJSON-1534360057 tempest-AttachVolumeTestJSON-1534360057-project] 10.222.0.81 "GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549" status: 404 len: 111 microversion: 2.1 time: 0.027416 Nov 22 23:09:46.449857 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 624/1227] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:46 2021] GET /compute/v2.1/servers/ce09954f-3efe-4542-9eb8-c1be3bc21549 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:09:51.642126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-421069406", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "415cb5eb-0653-4d1f-9a09-4c55d934d0bf"}]}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:51.695153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.network.neutron [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] validate_networks() for [('415cb5eb-0653-4d1f-9a09-4c55d934d0bf', None, None, None, None, None)] {{(pid=116338) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:09:52.052222 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:09:52.052643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image limits 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:09:52.053116 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:09:52.053553 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image pref 0:0:0 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:09:52.054012 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.virt.hardware [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116338) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:09:52.063155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:52.063599 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:52.064406 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:52.064831 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:52.081811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:09:52.085812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for user 41bac9e407294ed6a9fbf9c26fae51ff and project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:09:52.096582 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Going to run 1 instances... {{(pid=116338) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:09:52.099755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116338) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:09:52.145345 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a331a5c9-819f-463b-b175-71390c64f83a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624191 Nov 22 23:09:52.145954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 604/1228] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:09:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:09:52.155801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3ed9d7a8-4924-4af2-a16a-3bcfb230018c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:52.156422 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3ed9d7a8-4924-4af2-a16a-3bcfb230018c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:52.209125 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3ed9d7a8-4924-4af2-a16a-3bcfb230018c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:52.215819 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3ed9d7a8-4924-4af2-a16a-3bcfb230018c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1217 microversion: 2.1 time: 0.063822 Nov 22 23:09:52.216384 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 625/1229] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:52 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:53.233959 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:53.235336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:53.243442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:53.244475 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:53.244951 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:53.245561 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:53.340528 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:53.348556 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5d599b6e-076a-497c-b7f9-7d678194620a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1275 microversion: 2.1 time: 0.118769 Nov 22 23:09:53.349126 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 605/1230] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:53 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:54.365784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:54.367348 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:54.374458 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:54.375237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:54.376285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:54.377080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:54.628822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:54.636317 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-09891d94-b517-4f5b-a65e-8dd72aabeacc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.274537 Nov 22 23:09:54.637186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 626/1231] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:54 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:54.770693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-3681dd19-df80-4d6c-9061-482c0920e15f req-86ecbc1d-ebae-472c-a6e5-12e245e115a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be176b1b-ac56-4820-828f-d540ef9018f4", "tag": "ffebb815-24db-4e82-bc2e-25eb4ed18d2e"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:09:54.772225 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:09:54.772225 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:09:54.779699 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3681dd19-df80-4d6c-9061-482c0920e15f req-86ecbc1d-ebae-472c-a6e5-12e245e115a4 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:54.780421 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3681dd19-df80-4d6c-9061-482c0920e15f req-86ecbc1d-ebae-472c-a6e5-12e245e115a4 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:54.792409 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-3681dd19-df80-4d6c-9061-482c0920e15f req-86ecbc1d-ebae-472c-a6e5-12e245e115a4 service nova] Creating event network-changed:ffebb815-24db-4e82-bc2e-25eb4ed18d2e for instance be176b1b-ac56-4820-828f-d540ef9018f4 on hv-cinder-81883 Nov 22 23:09:54.797152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-3681dd19-df80-4d6c-9061-482c0920e15f req-86ecbc1d-ebae-472c-a6e5-12e245e115a4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030389 Nov 22 23:09:54.797801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 606/1232] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:09:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:09:55.654035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:55.654642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:55.662100 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:55.662546 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:55.663341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:55.663773 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:55.819474 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:55.826767 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-39954fb4-3ada-4a4b-a22c-a132dce5f536 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.176306 Nov 22 23:09:55.827331 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 627/1233] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:55 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:56.845642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:56.846465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:56.855171 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:56.855619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:56.856412 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:56.856849 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:57.007498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:57.014988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2b322f4d-bd35-4be0-8e60-f1c4fe46f132 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.174338 Nov 22 23:09:57.015574 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 607/1234] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:56 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:58.032198 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:58.032818 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:58.039992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:58.040456 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:58.041229 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:58.041731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:58.173719 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:58.181021 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f5ba2be7-8866-494a-94f4-1d9bb366b554 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.152828 Nov 22 23:09:58.181595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 628/1235] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:58 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:09:59.197352 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:09:59.197934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:09:59.204278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:59.204727 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:59.205512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:09:59.205979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:09:59.338477 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:09:59.345636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-45f98d13-8f85-4c0a-8968-6ee3d201b83d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.152004 Nov 22 23:09:59.346273 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 608/1236] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:09:59 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:00.363491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:00.364154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:00.370515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:00.370964 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:00.371753 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:00.372190 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:00.505460 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:00.512639 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cce4e175-f7df-41d2-9b5d-2be7c9a8fcff tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.153417 Nov 22 23:10:00.513191 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 629/1237] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:00 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:01.529549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:01.530168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:01.537221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:01.537691 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:01.538465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:01.538896 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:01.669343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:01.676779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-eb4b2ad2-788c-4419-b298-3de5aa51e7ae tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.150858 Nov 22 23:10:01.677566 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 609/1238] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:01 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:01.804437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-7833fb76-0e53-4b93-8422-c83d70b5fb81 req-12d111be-9a9e-492f-8c28-4321cbbc4cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be176b1b-ac56-4820-828f-d540ef9018f4", "name": "network-vif-plugged", "status": "completed", "tag": "ffebb815-24db-4e82-bc2e-25eb4ed18d2e"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:01.806146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:01.806146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:10:01.814385 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-7833fb76-0e53-4b93-8422-c83d70b5fb81 req-12d111be-9a9e-492f-8c28-4321cbbc4cbd service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:01.814847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-7833fb76-0e53-4b93-8422-c83d70b5fb81 req-12d111be-9a9e-492f-8c28-4321cbbc4cbd service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:01.826486 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-7833fb76-0e53-4b93-8422-c83d70b5fb81 req-12d111be-9a9e-492f-8c28-4321cbbc4cbd service nova] Creating event network-vif-plugged:ffebb815-24db-4e82-bc2e-25eb4ed18d2e for instance be176b1b-ac56-4820-828f-d540ef9018f4 on hv-cinder-81883 Nov 22 23:10:01.832277 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-7833fb76-0e53-4b93-8422-c83d70b5fb81 req-12d111be-9a9e-492f-8c28-4321cbbc4cbd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031485 Nov 22 23:10:01.832864 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 630/1239] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:02.693737 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:02.694348 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:02.700682 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:02.701167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:02.701985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:02.702423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:02.831812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:02.839208 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-00759520-77b2-4585-8e33-54db43889cf3 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1317 microversion: 2.1 time: 0.149745 Nov 22 23:10:02.839783 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 610/1240] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:02 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:03.858374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:03.859068 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:03.865837 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:03.866290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:03.867063 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:03.867500 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:03.997653 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:04.005864 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f5c5147f-95f9-4e68-95f1-202e0c4f4651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1507 microversion: 2.1 time: 0.152085 Nov 22 23:10:04.006465 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 631/1241] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:03 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:05.349860 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "482ed1a7-9650-4bb2-be7d-22db7bbd3211"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:05.350912 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:05.357372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:05.357850 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:05.358625 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:05.359086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:05.630083 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ffa06030-009b-4614-b107-222d860e038c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284270 Nov 22 23:10:05.630892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 611/1242] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:10:05 2021] POST /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:13.130311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1856639624", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "415cb5eb-0653-4d1f-9a09-4c55d934d0bf"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:13.183341 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] validate_networks() for [('415cb5eb-0653-4d1f-9a09-4c55d934d0bf', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:10:13.594481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:10:13.594902 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:10:13.595371 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:10:13.595781 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:10:13.596707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:10:13.605471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:13.605948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:13.606755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:13.607191 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:13.624146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:10:13.627976 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for user 41bac9e407294ed6a9fbf9c26fae51ff and project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:10:13.638814 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:10:13.641080 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:10:13.686338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-04848fd2-72d0-4dd1-8e02-887375697072 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559715 Nov 22 23:10:13.686972 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 632/1243] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:10:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:10:13.697837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-12195f9d-a678-465d-8b08-ebea0975c9aa tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:13.698529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-12195f9d-a678-465d-8b08-ebea0975c9aa tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:13.750576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-12195f9d-a678-465d-8b08-ebea0975c9aa tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:13.757532 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-12195f9d-a678-465d-8b08-ebea0975c9aa tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1218 microversion: 2.1 time: 0.064348 Nov 22 23:10:13.758170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 612/1244] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:13 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:14.775225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:14.775856 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:14.782265 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:14.782720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:14.783511 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:14.786453 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:14.852608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:14.860591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-91d24d1f-2462-4f79-bc07-396ed636f199 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1270 microversion: 2.1 time: 0.089620 Nov 22 23:10:14.861176 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 633/1245] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:14 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:15.878306 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:15.879183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:15.887097 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:15.887611 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:15.888478 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:15.888941 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:16.128877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:16.136253 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-95718865-3374-41a1-b837-61a410697e0e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.262410 Nov 22 23:10:16.136830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 613/1246] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:15 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:16.259532 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-15d8660b-bf1b-4ad4-baa8-eb7cbe493045 req-eb24816a-d4fe-496f-b32f-894b3916095c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ef14e4-bf9d-41c7-b87e-b674d18f978d", "tag": "a0c65ea2-dc92-4e3e-884f-d9c2e7233d0d"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:16.261218 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:16.261218 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:10:16.269124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-15d8660b-bf1b-4ad4-baa8-eb7cbe493045 req-eb24816a-d4fe-496f-b32f-894b3916095c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:16.270105 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-15d8660b-bf1b-4ad4-baa8-eb7cbe493045 req-eb24816a-d4fe-496f-b32f-894b3916095c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:16.281119 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-15d8660b-bf1b-4ad4-baa8-eb7cbe493045 req-eb24816a-d4fe-496f-b32f-894b3916095c service nova] Creating event network-changed:a0c65ea2-dc92-4e3e-884f-d9c2e7233d0d for instance 39ef14e4-bf9d-41c7-b87e-b674d18f978d on hv-cinder-81883 Nov 22 23:10:16.286963 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-15d8660b-bf1b-4ad4-baa8-eb7cbe493045 req-eb24816a-d4fe-496f-b32f-894b3916095c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031153 Nov 22 23:10:16.287558 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 634/1247] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:17.153100 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:17.153862 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:17.160946 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:17.161396 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:17.162529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:17.162981 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:17.362779 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:17.371376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7943f581-021c-46c6-92f7-f1250d6bcff1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.221842 Nov 22 23:10:17.372378 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 614/1248] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:17 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:18.389380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:18.390170 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:18.396706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:18.397155 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:18.397965 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:18.398398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:18.528784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:18.537321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-69775a1d-80f7-4cd2-8d3a-409332f3f06a tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.152616 Nov 22 23:10:18.537944 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 635/1249] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:18 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:19.555948 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:19.556604 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:19.563475 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:19.563919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:19.564709 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:19.565738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:19.699460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:19.706747 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-af54cbf3-7657-4fe0-843b-7e392047cd52 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.154532 Nov 22 23:10:19.707302 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 615/1250] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:19 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:20.724252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:20.724809 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:20.731098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:20.731543 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:20.732321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:20.732755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:20.871263 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:20.879121 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32100a7f-3998-47b4-97c5-a155850645c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.159433 Nov 22 23:10:20.879685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 636/1251] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:20 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:21.895879 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:21.896631 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:21.903062 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:21.903514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:21.904308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:21.904745 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:21.987628 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-6fa265c6-e885-438b-a7d4-074c2c317098 req-960cc736-a460-4936-89eb-52b98da1c959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ef14e4-bf9d-41c7-b87e-b674d18f978d", "name": "network-vif-plugged", "status": "completed", "tag": "a0c65ea2-dc92-4e3e-884f-d9c2e7233d0d"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:21.989391 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:21.989391 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:10:21.996615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-6fa265c6-e885-438b-a7d4-074c2c317098 req-960cc736-a460-4936-89eb-52b98da1c959 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:21.997107 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-6fa265c6-e885-438b-a7d4-074c2c317098 req-960cc736-a460-4936-89eb-52b98da1c959 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:22.008866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-6fa265c6-e885-438b-a7d4-074c2c317098 req-960cc736-a460-4936-89eb-52b98da1c959 service nova] Creating event network-vif-plugged:a0c65ea2-dc92-4e3e-884f-d9c2e7233d0d for instance 39ef14e4-bf9d-41c7-b87e-b674d18f978d on hv-cinder-81883 Nov 22 23:10:22.014698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-6fa265c6-e885-438b-a7d4-074c2c317098 req-960cc736-a460-4936-89eb-52b98da1c959 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101810 Nov 22 23:10:22.015311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 637/1252] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:10:22.045233 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:22.053350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fbb0f587-a098-43df-b575-1cb04fa4572e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.161236 Nov 22 23:10:22.053962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 616/1253] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:21 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:23.070776 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:23.071501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:23.078176 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:23.078622 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:23.079398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:23.079829 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:23.209462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:23.216758 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-71d01eb3-f48e-4b50-90e1-94c94ef120b4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1318 microversion: 2.1 time: 0.149985 Nov 22 23:10:23.217335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 638/1254] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:23 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:24.233247 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:24.233848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:24.240242 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.240685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.241456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.241911 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.375616 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:24.383252 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c4b05e96-eff4-4662-8bd0-e162cf2a493e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1508 microversion: 2.1 time: 0.153723 Nov 22 23:10:24.383821 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 617/1255] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:24 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:24.400148 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "482ed1a7-9650-4bb2-be7d-22db7bbd3211"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:24.401186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:24.408069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.409127 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.410076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.410529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.490168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] HTTP exception thrown: Invalid volume: volume 482ed1a7-9650-4bb2-be7d-22db7bbd3211 is already attached to instances: be176b1b-ac56-4820-828f-d540ef9018f4 Nov 22 23:10:24.490669 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Returning 400 to user: Invalid volume: volume 482ed1a7-9650-4bb2-be7d-22db7bbd3211 is already attached to instances: be176b1b-ac56-4820-828f-d540ef9018f4 {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:24.491515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-35a1b826-ea8c-4d71-aeda-2d2344a2612f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095287 Nov 22 23:10:24.492104 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 639/1256] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:10:24 2021] POST /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 23:10:24.550005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:24.550495 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:24.556398 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.556838 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.557628 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.558075 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.639418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lazy-loading 'services' on Instance uuid be176b1b-ac56-4820-828f-d540ef9018f4 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:10:24.712642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b34b191e-95ee-4bb7-b5bd-ddb5cf8de4a0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments/482ed1a7-9650-4bb2-be7d-22db7bbd3211" status: 202 len: 0 microversion: 2.1 time: 0.166394 Nov 22 23:10:24.713308 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 618/1257] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:10:24 2021] DELETE /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments/482ed1a7-9650-4bb2-be7d-22db7bbd3211 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:10:24.721792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:24.722785 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:24.728752 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.729201 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.730026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:24.730459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:24.761235 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-66d306ac-9e0b-4108-a478-2caf026d2d92 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043237 Nov 22 23:10:24.761738 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 640/1258] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:10:24 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:25.775282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:25.776486 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:25.783209 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:25.784313 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:25.785456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:25.785965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:25.817445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-92600012-15dd-45f7-b3fc-6ee538619d2d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047337 Nov 22 23:10:25.818375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 619/1259] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:10:25 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:10:25.921061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1851020590", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "415cb5eb-0653-4d1f-9a09-4c55d934d0bf"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:25.973267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] validate_networks() for [('415cb5eb-0653-4d1f-9a09-4c55d934d0bf', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:10:26.569405 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:10:26.570000 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:10:26.570431 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:10:26.570838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:10:26.571244 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:10:26.580225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:26.581269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:26.582289 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:26.582852 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:26.600760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:10:26.606874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for user 41bac9e407294ed6a9fbf9c26fae51ff and project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:10:26.622954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:10:26.625942 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:10:26.676699 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f2038b29-6b38-4051-977f-c8e311d904c9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759342 Nov 22 23:10:26.677464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 641/1260] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:10:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:10:26.687812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-dd6f08da-677e-4f7e-a1ee-76a126023681 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:26.688661 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-dd6f08da-677e-4f7e-a1ee-76a126023681 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:26.746471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-dd6f08da-677e-4f7e-a1ee-76a126023681 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:26.753652 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-dd6f08da-677e-4f7e-a1ee-76a126023681 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1218 microversion: 2.1 time: 0.069563 Nov 22 23:10:26.754509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 620/1261] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:26 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:27.771547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:27.772189 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:27.778382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:27.778838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:27.779618 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:27.780082 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:27.868807 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:27.878430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1f38f59a-498d-4f51-8fdc-f4ed1bb0b483 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1278 microversion: 2.1 time: 0.110047 Nov 22 23:10:27.879256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 642/1262] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:27 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1278 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:28.897512 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:28.898151 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:28.905018 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:28.905568 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:28.906899 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:28.907545 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:29.116395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:29.123867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f35727b3-f640-49e0-b1ae-baaef6fa7b98 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.231507 Nov 22 23:10:29.124682 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 621/1263] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:28 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:29.180442 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-fc9649f7-0a47-4a92-8510-6929d5973f56 req-11197219-35f7-477b-9e6c-421a8c11bdae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c826379-b173-4887-bf56-92001a040979", "tag": "431b34e0-b753-44ee-b376-f24909d2b4c5"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:29.182332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:29.182332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:10:29.190918 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-fc9649f7-0a47-4a92-8510-6929d5973f56 req-11197219-35f7-477b-9e6c-421a8c11bdae service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:29.191961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-fc9649f7-0a47-4a92-8510-6929d5973f56 req-11197219-35f7-477b-9e6c-421a8c11bdae service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:29.203058 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-fc9649f7-0a47-4a92-8510-6929d5973f56 req-11197219-35f7-477b-9e6c-421a8c11bdae service nova] Creating event network-changed:431b34e0-b753-44ee-b376-f24909d2b4c5 for instance 4c826379-b173-4887-bf56-92001a040979 on hv-cinder-81883 Nov 22 23:10:29.208836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-fc9649f7-0a47-4a92-8510-6929d5973f56 req-11197219-35f7-477b-9e6c-421a8c11bdae service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032070 Nov 22 23:10:29.209491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 643/1264] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:30.141433 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:30.142079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:30.148956 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:30.149405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:30.150229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:30.150670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:30.282762 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:30.291195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d97ea67c-ffb0-4628-9add-6cd3cbf53748 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.153488 Nov 22 23:10:30.291767 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 622/1265] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:30 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:31.309160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:31.310062 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:31.316724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:31.317197 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:31.318023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:31.318462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:31.462067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:31.469642 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-44d4b379-b7ff-44bd-9448-91394450ef3d tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.164868 Nov 22 23:10:31.470218 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 644/1266] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:31 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:32.486988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:32.487598 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:32.493929 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:32.494372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:32.495146 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:32.495576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:32.625205 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:32.632576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e2c12632-994b-495e-a85e-18645f156b05 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.149287 Nov 22 23:10:32.633149 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 623/1267] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:32 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:33.649804 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:33.650663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:33.657130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:33.657576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:33.658404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:33.658839 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:33.792014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:33.799761 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-68824270-e659-4923-8444-446f2d7e0a87 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.153136 Nov 22 23:10:33.800476 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 645/1268] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:33 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:34.817036 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:34.817663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:34.823998 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:34.824443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:34.825212 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:34.825670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:34.954108 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:34.961649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-756e622f-e4aa-492a-8909-697eaa84118f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.148819 Nov 22 23:10:34.962278 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 624/1269] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:34 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:35.978477 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:35.979076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:35.985396 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:35.985882 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:35.987217 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:35.987670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:35.999877 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-999b096c-c6f0-4909-b5f3-5a88d6886209 req-52c233d9-7c56-4962-85e7-6435761bb5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c826379-b173-4887-bf56-92001a040979", "name": "network-vif-plugged", "status": "completed", "tag": "431b34e0-b753-44ee-b376-f24909d2b4c5"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:36.001705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:36.001705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:10:36.009588 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-999b096c-c6f0-4909-b5f3-5a88d6886209 req-52c233d9-7c56-4962-85e7-6435761bb5e1 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:36.010328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-999b096c-c6f0-4909-b5f3-5a88d6886209 req-52c233d9-7c56-4962-85e7-6435761bb5e1 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:36.022601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-999b096c-c6f0-4909-b5f3-5a88d6886209 req-52c233d9-7c56-4962-85e7-6435761bb5e1 service nova] Creating event network-vif-plugged:431b34e0-b753-44ee-b376-f24909d2b4c5 for instance 4c826379-b173-4887-bf56-92001a040979 on hv-cinder-81883 Nov 22 23:10:36.027757 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-999b096c-c6f0-4909-b5f3-5a88d6886209 req-52c233d9-7c56-4962-85e7-6435761bb5e1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031795 Nov 22 23:10:36.028369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 625/1270] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:36.135014 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:36.143382 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-37ee87c5-2d92-40ba-9b84-aa88f117073b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.167855 Nov 22 23:10:36.144706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 646/1271] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:35 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:37.162454 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:37.163092 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:37.169204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:37.169662 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:37.170437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:37.170869 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:37.303187 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:37.310565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8829f2a4-cba6-48c5-bdd1-b6629d63b0bd tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1318 microversion: 2.1 time: 0.152702 Nov 22 23:10:37.311139 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 626/1272] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:37 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:38.327572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:38.328177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:38.334914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.335360 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.336168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.336602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.363995 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:38.364898 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:38.371216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.371663 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.372434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.372862 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.403282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f79eeb4d-817f-491f-b41f-285db57fbb25 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043503 Nov 22 23:10:38.403837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 627/1273] 10.222.0.81 () {60 vars in 1342 bytes} [Mon Nov 22 23:10:38 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:38.461971 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:38.462462 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:38.468152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.468600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.469373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.469837 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.477923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:38.485050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-65b24678-934b-4436-81b3-a675dd420a91 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1508 microversion: 2.1 time: 0.161121 Nov 22 23:10:38.485643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 647/1274] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:38 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:38.495797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:10:38.576265 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-e5637a5d-a7d1-4d2c-bf38-7865ec32a979 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 204 len: 0 microversion: 2.20 time: 0.117599 Nov 22 23:10:38.577079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 628/1275] 10.222.0.81 () {60 vars in 1279 bytes} [Mon Nov 22 23:10:38 2021] DELETE /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 22 23:10:38.585679 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:38.586282 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:38.592133 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.592565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.593553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:38.594025 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:38.732685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:38.742074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:38.743724 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:38.744887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-948e3866-6192-4d4d-9624-02d1834a39b6 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.163142 Nov 22 23:10:38.745437 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 648/1276] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:10:38 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 23:10:39.763730 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:39.764423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:39.771472 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:39.771933 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:39.772831 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:39.773277 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:39.809885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "032297e5-57de-4fd9-9d7d-204dc7b042b1"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:39.810971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:39.817952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:39.818398 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:39.819172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:39.819602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:39.909506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:39.917917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:39.919506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:39.920676 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ca303bc4-d9a9-4b09-be6c-796197fa1e36 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.160956 Nov 22 23:10:39.921426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 629/1277] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:10:39 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:10:40.076772 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dbc592d7-ae88-4e1a-8ec0-c313efe43dc7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270352 Nov 22 23:10:40.077440 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 649/1278] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:10:39 2021] POST /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:10:40.940351 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:40.940974 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:40.947559 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:40.947778 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:40.948575 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:40.949019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:41.209874 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:41.218315 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:41.220154 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:41.221400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-97a3d51f-9e0f-4840-ba28-028d20fc3305 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1723 microversion: 2.20 time: 0.284862 Nov 22 23:10:41.222064 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 630/1279] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:10:40 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:10:41.665185 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-296c829b-e825-4ed6-a812-604bb31c4642 req-aab520c7-7f7e-46af-9ced-e4355abad992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0ef15c-e6e3-4c71-b600-43ab707f7d21", "name": "network-vif-deleted", "tag": "8da32319-51d1-4c63-adca-4c2685c82057"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:41.666994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:41.666994 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:10:41.675650 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-296c829b-e825-4ed6-a812-604bb31c4642 req-aab520c7-7f7e-46af-9ced-e4355abad992 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:41.676104 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-296c829b-e825-4ed6-a812-604bb31c4642 req-aab520c7-7f7e-46af-9ced-e4355abad992 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:41.687118 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-296c829b-e825-4ed6-a812-604bb31c4642 req-aab520c7-7f7e-46af-9ced-e4355abad992 service nova] Creating event network-vif-deleted:8da32319-51d1-4c63-adca-4c2685c82057 for instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 on hv-cinder-81883 Nov 22 23:10:41.692670 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-296c829b-e825-4ed6-a812-604bb31c4642 req-aab520c7-7f7e-46af-9ced-e4355abad992 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Nov 22 23:10:41.694289 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 650/1280] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:42.240296 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:42.240915 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:42.249050 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:42.249507 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:42.250341 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:42.251047 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:42.294051 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:42.294506 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:42.294986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lazy-loading 'fault' on Instance uuid 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:10:42.337669 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:42.345530 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:42.347731 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66e5af1ce0394d6f963d368036c8c0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387b910bbc6a480a88d07859ab82cfe6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:42.348955 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4b2063ab-10e4-4a8e-b0df-c24f7f66ffce tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 200 len: 1370 microversion: 2.20 time: 0.113055 Nov 22 23:10:42.349515 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 631/1281] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:10:42 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 23:10:43.373039 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:43.373794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:43.380773 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:43.381225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:43.382046 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:43.382488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:43.396366 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] HTTP exception thrown: Instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 could not be found. Nov 22 23:10:43.396949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Returning 404 to user: Instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:43.397812 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-04d9cd35-ad0d-4a85-85d7-b673c21a7921 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 404 len: 111 microversion: 2.20 time: 0.029254 Nov 22 23:10:43.398343 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 651/1282] 10.222.0.81 () {60 vars in 1276 bytes} [Mon Nov 22 23:10:43 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 23:10:43.406410 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4b68d90e-4d9f-4d96-ae18-38e31356ff72 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '.version_select at 0x7fefc9f753a0>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:43.426044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4b68d90e-4d9f-4d96-ae18-38e31356ff72 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525895099" status: 204 len: 0 microversion: 2.20 time: 0.023211 Nov 22 23:10:43.426811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 632/1283] 10.222.0.81 () {60 vars in 1258 bytes} [Mon Nov 22 23:10:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525895099 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 23:10:45.228629 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:45.229167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:45.235740 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:45.236703 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:45.237475 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:45.237952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:45.251036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] HTTP exception thrown: Instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 could not be found. Nov 22 23:10:45.251620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Returning 404 to user: Instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:45.252966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ae6a8bdb-9dd6-42fa-82ff-73ce99cdc37e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 404 len: 111 microversion: 2.1 time: 0.027986 Nov 22 23:10:45.253501 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 652/1284] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:10:45 2021] DELETE /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:10:45.262328 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:45.263133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6b0ef15c-e6e3-4c71-b600-43ab707f7d21] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:45.270042 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:45.270492 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:45.271294 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:45.271733 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:45.288077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] HTTP exception thrown: Instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 could not be found. Nov 22 23:10:45.288976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Returning 404 to user: Instance 6b0ef15c-e6e3-4c71-b600-43ab707f7d21 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:45.289973 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-96ad8b81-0167-4b93-9098-a6b86ddb03e7 tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21" status: 404 len: 111 microversion: 2.1 time: 0.032278 Nov 22 23:10:45.290713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 633/1285] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:45 2021] GET /compute/v2.1/servers/6b0ef15c-e6e3-4c71-b600-43ab707f7d21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:10:46.438760 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:46.440071 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:46.446640 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:46.447085 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:46.447861 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:46.448293 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:46.461730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] HTTP exception thrown: Instance 6383769b-dc5f-4c00-9651-484e2904efcc could not be found. Nov 22 23:10:46.462345 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Returning 404 to user: Instance 6383769b-dc5f-4c00-9651-484e2904efcc could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:46.463161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5ddad58e-915d-4c9f-a769-16b831d8c40e tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 404 len: 111 microversion: 2.1 time: 0.028095 Nov 22 23:10:46.463689 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 653/1286] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:10:46 2021] DELETE /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:10:46.471481 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:46.472111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] [instance: 6383769b-dc5f-4c00-9651-484e2904efcc] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:46.478370 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:46.478816 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:46.479602 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:46.480041 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:46.495619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] HTTP exception thrown: Instance 6383769b-dc5f-4c00-9651-484e2904efcc could not be found. Nov 22 23:10:46.496241 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] Returning 404 to user: Instance 6383769b-dc5f-4c00-9651-484e2904efcc could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:46.497084 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fb2ea99b-e021-44b2-a4cd-fbfccc7658eb tempest-AttachVolumeShelveTestJSON-1323804820 tempest-AttachVolumeShelveTestJSON-1323804820-project] 10.222.0.81 "GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc" status: 404 len: 111 microversion: 2.1 time: 0.029385 Nov 22 23:10:46.497839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 634/1287] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:46 2021] GET /compute/v2.1/servers/6383769b-dc5f-4c00-9651-484e2904efcc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:10:47.585120 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "032297e5-57de-4fd9-9d7d-204dc7b042b1"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:47.586215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:47.592615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:47.593316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:47.594154 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:47.594600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:47.682242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] HTTP exception thrown: Invalid volume: volume 032297e5-57de-4fd9-9d7d-204dc7b042b1 is already attached to instances: 4c826379-b173-4887-bf56-92001a040979 Nov 22 23:10:47.683020 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Returning 400 to user: Invalid volume: volume 032297e5-57de-4fd9-9d7d-204dc7b042b1 is already attached to instances: 4c826379-b173-4887-bf56-92001a040979 {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:10:47.684325 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-32f36f0d-4af8-42c5-a022-3d1a0d285beb tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104066 Nov 22 23:10:47.684997 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 654/1288] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:10:47 2021] POST /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 23:10:47.751179 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:47.751827 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:47.758902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:47.758902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:47.759685 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:47.760150 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:47.859853 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lazy-loading 'services' on Instance uuid 4c826379-b173-4887-bf56-92001a040979 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:10:47.945582 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b7c23292-b762-43fd-b533-c9fdeebdf2f6 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments/032297e5-57de-4fd9-9d7d-204dc7b042b1" status: 202 len: 0 microversion: 2.1 time: 0.199512 Nov 22 23:10:47.946649 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 635/1289] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:10:47 2021] DELETE /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments/032297e5-57de-4fd9-9d7d-204dc7b042b1 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:10:47.961908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:47.962821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:47.969092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:47.970378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:47.971768 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:47.972365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:48.005797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4fe75bb2-e058-4f56-a6e3-752ce8a00990 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047635 Nov 22 23:10:48.006389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 655/1290] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:10:47 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:49.019659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:49.021195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:49.029286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:49.029286 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:49.030138 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:49.030580 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:49.066231 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-8c54f49b-0515-42bb-8ffd-bbe392da83b2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051942 Nov 22 23:10:49.066684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 636/1291] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:10:49 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:10:49.176099 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1976767909", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452", "networks": [{"uuid": "415cb5eb-0653-4d1f-9a09-4c55d934d0bf"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:49.234434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] validate_networks() for [('415cb5eb-0653-4d1f-9a09-4c55d934d0bf', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:10:49.911883 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:10:49.913017 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:10:49.913889 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:10:49.914493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:10:49.915048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:10:49.936490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:49.936742 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:49.937593 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:49.938304 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:49.980922 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:10:49.991826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Getting quotas for user 41bac9e407294ed6a9fbf9c26fae51ff and project 68a4db5f8dc747ad8dbb2d906029a395. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:10:50.005576 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:10:50.007993 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:10:50.068821 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f7f89f68-6b2a-45ab-8828-898251b5393f tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897638 Nov 22 23:10:50.074977 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 656/1292] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:10:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:10:50.081293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-70f8ebbb-780b-47bc-bc59-f4eaaa451ddc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:50.082600 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-70f8ebbb-780b-47bc-bc59-f4eaaa451ddc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:50.162543 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-70f8ebbb-780b-47bc-bc59-f4eaaa451ddc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:50.170444 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-70f8ebbb-780b-47bc-bc59-f4eaaa451ddc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1218 microversion: 2.1 time: 0.094526 Nov 22 23:10:50.171216 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 637/1293] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:50 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:10:51.188660 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:51.189296 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:51.195734 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:51.196182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:51.197006 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:51.197505 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:51.298089 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:51.306981 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e5d30adf-8217-4b07-948a-d50067f90dc8 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1278 microversion: 2.1 time: 0.122440 Nov 22 23:10:51.307565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 657/1294] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:51 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:52.325959 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:52.327298 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:52.333491 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:52.333990 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:52.334795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:52.335280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:52.573170 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:52.582797 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-1fc10589-4e7a-4310-86b1-66ceb8132c6e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.260653 Nov 22 23:10:52.583434 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 638/1295] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:52 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:52.790624 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-cfc4ba0d-5f77-4e00-b67a-b3655199cb48 req-9255f5b2-1017-4e09-9d62-7364e3dd35bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42b54ba-f556-4282-9656-c2442bc8f1ef", "tag": "026135b7-3b27-4e8b-b597-31748502f124"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:52.792536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:52.792536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:10:52.800039 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-cfc4ba0d-5f77-4e00-b67a-b3655199cb48 req-9255f5b2-1017-4e09-9d62-7364e3dd35bf service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:52.800489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-cfc4ba0d-5f77-4e00-b67a-b3655199cb48 req-9255f5b2-1017-4e09-9d62-7364e3dd35bf service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:52.812024 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-cfc4ba0d-5f77-4e00-b67a-b3655199cb48 req-9255f5b2-1017-4e09-9d62-7364e3dd35bf service nova] Creating event network-changed:026135b7-3b27-4e8b-b597-31748502f124 for instance d42b54ba-f556-4282-9656-c2442bc8f1ef on hv-cinder-81883 Nov 22 23:10:52.817397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-cfc4ba0d-5f77-4e00-b67a-b3655199cb48 req-9255f5b2-1017-4e09-9d62-7364e3dd35bf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Nov 22 23:10:52.818244 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 658/1296] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:53.601829 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:53.603168 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:53.614119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:53.615085 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:53.616436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:53.617128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:53.881379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:53.888740 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-4c71c404-cabf-4ae1-94fa-4b923bed343b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.290831 Nov 22 23:10:53.889312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 639/1297] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:53 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:54.908267 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:54.908968 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:54.915022 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:54.915461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:54.916266 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:54.916702 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:55.055882 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:55.063515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-160d321a-fb68-4649-ac5e-290d1fd83ed5 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.159947 Nov 22 23:10:55.065029 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 659/1298] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:54 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:56.085285 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:56.086178 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:56.093180 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:56.093755 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:56.094505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:56.094942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:56.254539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:56.261794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fa5d77ee-746d-40a3-8cb4-de3318d6abed tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.181479 Nov 22 23:10:56.262367 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 640/1299] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:56 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:57.280211 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:57.280941 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:57.289794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:57.290270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:57.291064 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:57.291492 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:57.529569 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:57.537984 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-66770604-3374-489f-9804-0399da41757c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.261808 Nov 22 23:10:57.538481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 660/1300] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:57 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:58.143334 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-018e372c-4b08-4772-b83a-9ef507959e03 req-ee3bb8df-b957-41ce-8560-620a91ad342a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42b54ba-f556-4282-9656-c2442bc8f1ef", "name": "network-vif-plugged", "status": "completed", "tag": "026135b7-3b27-4e8b-b597-31748502f124"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:10:58.144964 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:10:58.144964 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:10:58.153078 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-018e372c-4b08-4772-b83a-9ef507959e03 req-ee3bb8df-b957-41ce-8560-620a91ad342a service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:58.153601 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-018e372c-4b08-4772-b83a-9ef507959e03 req-ee3bb8df-b957-41ce-8560-620a91ad342a service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:58.166391 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-018e372c-4b08-4772-b83a-9ef507959e03 req-ee3bb8df-b957-41ce-8560-620a91ad342a service nova] Creating event network-vif-plugged:026135b7-3b27-4e8b-b597-31748502f124 for instance d42b54ba-f556-4282-9656-c2442bc8f1ef on hv-cinder-81883 Nov 22 23:10:58.171746 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-018e372c-4b08-4772-b83a-9ef507959e03 req-ee3bb8df-b957-41ce-8560-620a91ad342a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032869 Nov 22 23:10:58.172641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 641/1301] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:10:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:10:58.556293 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:58.557019 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:58.563773 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:58.564940 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:58.565713 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:58.566187 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:58.718866 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:58.727353 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-20685bba-a2f4-4692-92d1-c64810abdf77 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.175363 Nov 22 23:10:58.735294 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 661/1302] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:58 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:10:59.745365 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:10:59.746120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:10:59.756646 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:59.757320 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:59.758264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:10:59.759061 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:10:59.911789 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:10:59.919167 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0c43e777-00cd-4954-9bd0-cc9e6ca6d925 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1318 microversion: 2.1 time: 0.177719 Nov 22 23:10:59.919732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 642/1303] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:10:59 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:00.936072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:00.936786 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:00.943272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:00.943745 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:00.944516 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:00.944952 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:01.088200 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:01.096264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-b30d76f1-098d-484c-a3d8-3a975a95566b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1509 microversion: 2.1 time: 0.163740 Nov 22 23:11:01.097020 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 662/1304] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:00 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:02.441809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1283aca9-504c-4924-891b-7cb7a8db87bc"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:02.442884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:02.450516 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:02.451259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:02.452609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:02.453359 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:02.711261 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2550b301-a314-4b38-b0e5-247d239b294e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "POST /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272875 Nov 22 23:11:02.712222 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 643/1305] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:11:02 2021] POST /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:08.832999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:08.833809 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:08.840497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:08.840822 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:08.841646 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:08.842092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:08.878186 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:08.974505 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-0afae144-1cee-468e-929e-f19f12c3c3e2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 204 len: 0 microversion: 2.1 time: 0.145731 Nov 22 23:11:08.975755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 663/1306] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:08 2021] DELETE /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:11:08.986718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:08.987461 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:08.993798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:08.994252 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:08.995035 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:08.995468 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:09.007418 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-773458d9-bf0f-4805-a8ba-8c5348624a08 req-04a0b418-9ce1-40f7-8d2e-6f395b4d5941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd19414-dc5d-4baa-a697-71ce6ffbb944", "tag": "9a32d6b5-5043-43fb-98e4-95f79601a894"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:09.009339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:09.009339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:11:09.017293 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-773458d9-bf0f-4805-a8ba-8c5348624a08 req-04a0b418-9ce1-40f7-8d2e-6f395b4d5941 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:09.018120 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-773458d9-bf0f-4805-a8ba-8c5348624a08 req-04a0b418-9ce1-40f7-8d2e-6f395b4d5941 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:09.031214 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-773458d9-bf0f-4805-a8ba-8c5348624a08 req-04a0b418-9ce1-40f7-8d2e-6f395b4d5941 service nova] Creating event network-changed:9a32d6b5-5043-43fb-98e4-95f79601a894 for instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 on hv-cinder-81883 Nov 22 23:11:09.038801 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-773458d9-bf0f-4805-a8ba-8c5348624a08 req-04a0b418-9ce1-40f7-8d2e-6f395b4d5941 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206281 Nov 22 23:11:09.039803 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 644/1307] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:09.174226 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:09.183622 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5c8e7d93-bdfc-44b5-9613-eecbc0759bf2 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1577 microversion: 2.1 time: 0.202504 Nov 22 23:11:09.184215 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 664/1308] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:08 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:10.203423 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:10.204109 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:10.210643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:10.211079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:10.211820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:10.212190 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:10.303690 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:10.304177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:10.310643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:10.311084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:10.311855 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:10.312285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:10.352920 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:10.360500 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-32d4078e-2d72-4da0-924e-1353a4c944d1 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1458 microversion: 2.1 time: 0.161434 Nov 22 23:11:10.362770 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 645/1309] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:10 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1458 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:11:10.393247 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lazy-loading 'services' on Instance uuid d42b54ba-f556-4282-9656-c2442bc8f1ef {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:11:10.463925 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-578bc5d9-34c2-41ef-9316-6a2117ec8f01 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments/1283aca9-504c-4924-891b-7cb7a8db87bc" status: 202 len: 0 microversion: 2.1 time: 0.163592 Nov 22 23:11:10.464823 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 665/1310] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:11:10 2021] DELETE /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments/1283aca9-504c-4924-891b-7cb7a8db87bc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 23:11:10.473811 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:10.474794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:10.481327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:10.481842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:10.482713 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:10.483187 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:10.514889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b3ab2677-2c28-4c8b-893c-723b94c31cf4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Nov 22 23:11:10.515452 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 646/1311] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:11:10 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:11.381842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:11.383190 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:11.393070 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:11.393754 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:11.394808 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:11.395698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:11.527756 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:11.528855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:11.538086 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:11.538605 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:11.539670 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:11.540290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:11.585657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-d914019e-867d-4e67-82e3-0b1af765c0b0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062109 Nov 22 23:11:11.587103 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 647/1312] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:11:11 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:11:11.688403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:11.697168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ab96a37c-3632-4e7b-9c10-349ba020d8fd tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1458 microversion: 2.1 time: 0.321413 Nov 22 23:11:11.698084 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 666/1313] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:11 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1458 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:12.054975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-1bb70cb9-5362-4d55-8063-e69a6a814d08 req-845a8fdc-746f-4796-9d8b-048d36724d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd19414-dc5d-4baa-a697-71ce6ffbb944", "name": "network-vif-deleted", "tag": "9a32d6b5-5043-43fb-98e4-95f79601a894"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:12.058742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:12.058742 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:11:12.071413 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-1bb70cb9-5362-4d55-8063-e69a6a814d08 req-845a8fdc-746f-4796-9d8b-048d36724d9e service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:12.072180 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-1bb70cb9-5362-4d55-8063-e69a6a814d08 req-845a8fdc-746f-4796-9d8b-048d36724d9e service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:12.086070 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-1bb70cb9-5362-4d55-8063-e69a6a814d08 req-845a8fdc-746f-4796-9d8b-048d36724d9e service nova] Creating event network-vif-deleted:9a32d6b5-5043-43fb-98e4-95f79601a894 for instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 on hv-cinder-81883 Nov 22 23:11:12.097509 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-1bb70cb9-5362-4d55-8063-e69a6a814d08 req-845a8fdc-746f-4796-9d8b-048d36724d9e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268305 Nov 22 23:11:12.099436 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 648/1314] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:11:12.597675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:12.599282 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:12.606681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:12.607167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:12.607971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:12.608444 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:12.645743 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fac45813-ac6b-4366-a9cf-7b12751418d4 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051946 Nov 22 23:11:12.646335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 667/1315] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:11:12 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:11:12.716435 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:12.718192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:12.728020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:12.728415 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:12.735008 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:12.736091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:12.788353 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:12.788802 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:12.790019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.objects.instance [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lazy-loading 'fault' on Instance uuid 4bd19414-dc5d-4baa-a697-71ce6ffbb944 {{(pid=116338) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:11:12.842842 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:12.853572 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ff1d3a48-7f50-4541-b549-f0ce47adbf1a tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 200 len: 1184 microversion: 2.1 time: 0.141702 Nov 22 23:11:12.854185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 649/1316] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:12 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 1184 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:13.870152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:13.870811 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:13.871176 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:13.871266 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 4bd19414-dc5d-4baa-a697-71ce6ffbb944] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:13.878420 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:13.879051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:13.879237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:13.879992 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:13.880426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:13.880876 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:13.881044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:13.881410 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:13.895290 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] HTTP exception thrown: Instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 could not be found. Nov 22 23:11:13.895885 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Returning 404 to user: Instance 4bd19414-dc5d-4baa-a697-71ce6ffbb944 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:13.896717 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-20842b1c-dab7-4377-a40e-b562cbc4fafb tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944" status: 404 len: 111 microversion: 2.1 time: 0.030711 Nov 22 23:11:13.897261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 668/1317] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:13 2021] GET /compute/v2.1/servers/4bd19414-dc5d-4baa-a697-71ce6ffbb944 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:13.906934 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:13.990155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-78ac62a9-3c98-4c10-9d61-95e64ab06020 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 204 len: 0 microversion: 2.1 time: 0.123191 Nov 22 23:11:13.991053 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 650/1318] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:13 2021] DELETE /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 23:11:13.998809 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:14.009715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:14.015765 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:14.016216 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:14.017549 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:14.018103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:14.149272 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:14.156880 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-272bdc02-549c-411b-93f8-6390163de413 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1515 microversion: 2.1 time: 0.161719 Nov 22 23:11:14.157534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 669/1319] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:13 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:15.175136 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:15.175832 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:15.182410 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:15.182861 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:15.183644 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:15.184077 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:15.318984 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:15.326534 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-56deda8b-75cc-48dc-92c2-f7546e149e15 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1515 microversion: 2.1 time: 0.155401 Nov 22 23:11:15.327097 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 651/1320] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:15 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:16.343369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:16.344110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:16.350706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:16.351152 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:16.351927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:16.352361 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:16.589264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:16.600784 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-633117dd-355f-42cd-9590-ea5f8dc41ff9 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1515 microversion: 2.1 time: 0.259001 Nov 22 23:11:16.611478 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 670/1321] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:16 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:16.954565 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-3b6bce45-5088-4882-925a-9a310fe51d69 req-a62cdee2-18b6-4dac-b70c-ad283a9f7a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42b54ba-f556-4282-9656-c2442bc8f1ef", "name": "network-vif-deleted", "tag": "026135b7-3b27-4e8b-b597-31748502f124"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:16.959975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:16.959975 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:11:16.969070 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3b6bce45-5088-4882-925a-9a310fe51d69 req-a62cdee2-18b6-4dac-b70c-ad283a9f7a03 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:16.969516 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-3b6bce45-5088-4882-925a-9a310fe51d69 req-a62cdee2-18b6-4dac-b70c-ad283a9f7a03 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:16.982103 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-3b6bce45-5088-4882-925a-9a310fe51d69 req-a62cdee2-18b6-4dac-b70c-ad283a9f7a03 service nova] Creating event network-vif-deleted:026135b7-3b27-4e8b-b597-31748502f124 for instance d42b54ba-f556-4282-9656-c2442bc8f1ef on hv-cinder-81883 Nov 22 23:11:16.989800 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-3b6bce45-5088-4882-925a-9a310fe51d69 req-a62cdee2-18b6-4dac-b70c-ad283a9f7a03 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042544 Nov 22 23:11:16.991133 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 652/1322] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:17.351339 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-a88cb73f-8c9e-4802-92a9-04744901d914 req-d657015e-57f2-425f-a459-ac08dd282a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d45b951-a55d-4405-b588-c9a39961ed7e", "tag": "706f4d9d-ccd1-4156-80f6-be31b459d5bf"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:17.352784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:17.352784 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:11:17.356604 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:17.357088 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:17.365264 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.365912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.366091 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-a88cb73f-8c9e-4802-92a9-04744901d914 req-d657015e-57f2-425f-a459-ac08dd282a6c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.366973 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-a88cb73f-8c9e-4802-92a9-04744901d914 req-d657015e-57f2-425f-a459-ac08dd282a6c service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.367725 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.368269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.379619 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-a88cb73f-8c9e-4802-92a9-04744901d914 req-d657015e-57f2-425f-a459-ac08dd282a6c service nova] Creating event network-changed:706f4d9d-ccd1-4156-80f6-be31b459d5bf for instance 2d45b951-a55d-4405-b588-c9a39961ed7e on hv-cinder-81883 Nov 22 23:11:17.385000 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-a88cb73f-8c9e-4802-92a9-04744901d914 req-d657015e-57f2-425f-a459-ac08dd282a6c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037461 Nov 22 23:11:17.385942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 653/1323] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:17.402213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:17.530608 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-81d0bbb5-62c5-489f-8e0e-1d293c24c00d tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 204 len: 0 microversion: 2.1 time: 0.186000 Nov 22 23:11:17.531715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 671/1324] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:17 2021] DELETE /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 23:11:17.543181 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:17.544290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:17.554229 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.554680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.555805 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.556363 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.619560 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:17.620347 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:17.631547 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.632233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.633210 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.636750 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.691111 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:17.691843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:17.692538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lazy-loading 'fault' on Instance uuid d42b54ba-f556-4282-9656-c2442bc8f1ef {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:11:17.766599 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:17.777380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8898d8c6-6cef-4639-a889-dda944f96310 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 200 len: 1308 microversion: 2.1 time: 0.161736 Nov 22 23:11:17.779245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 672/1325] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:17 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:18.176129 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:18.184102 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fb8c7c54-48c0-431c-baa6-89362d12ef7f tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1576 microversion: 2.1 time: 0.645305 Nov 22 23:11:18.184976 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 654/1326] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:17 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1576 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:18.795552 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:18.796156 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: d42b54ba-f556-4282-9656-c2442bc8f1ef] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:18.803356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:18.803806 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:18.804592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:18.805032 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:18.818825 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] HTTP exception thrown: Instance d42b54ba-f556-4282-9656-c2442bc8f1ef could not be found. Nov 22 23:11:18.819415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Returning 404 to user: Instance d42b54ba-f556-4282-9656-c2442bc8f1ef could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:18.820257 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ad2e9eeb-e2f3-4be8-a725-0c8ef606421b tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef" status: 404 len: 111 microversion: 2.1 time: 0.028442 Nov 22 23:11:18.820795 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 673/1327] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:18 2021] GET /compute/v2.1/servers/d42b54ba-f556-4282-9656-c2442bc8f1ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:19.201983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:19.202562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:19.209302 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:19.209799 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:19.210582 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:19.211019 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:19.350372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:19.357792 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5bd3e053-2174-4edc-823d-2cfd2129b9f9 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1457 microversion: 2.1 time: 0.159599 Nov 22 23:11:19.358352 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 655/1328] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:19 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1457 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:19.948970 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:19.949654 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:19.956900 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:19.957336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:19.958464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:19.959079 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:19.992553 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:20.005280 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-0d7501d8-e762-4539-8d9e-5562f6bbf904 req-db1f3083-6ea9-4a3f-9fdc-3e4553c5b7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d45b951-a55d-4405-b588-c9a39961ed7e", "name": "network-vif-deleted", "tag": "706f4d9d-ccd1-4156-80f6-be31b459d5bf"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:20.007642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:20.007642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:11:20.014809 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-0d7501d8-e762-4539-8d9e-5562f6bbf904 req-db1f3083-6ea9-4a3f-9fdc-3e4553c5b7f3 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:20.015264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-0d7501d8-e762-4539-8d9e-5562f6bbf904 req-db1f3083-6ea9-4a3f-9fdc-3e4553c5b7f3 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:20.028460 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-0d7501d8-e762-4539-8d9e-5562f6bbf904 req-db1f3083-6ea9-4a3f-9fdc-3e4553c5b7f3 service nova] Creating event network-vif-deleted:706f4d9d-ccd1-4156-80f6-be31b459d5bf for instance 2d45b951-a55d-4405-b588-c9a39961ed7e on hv-cinder-81883 Nov 22 23:11:20.034318 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-0d7501d8-e762-4539-8d9e-5562f6bbf904 req-db1f3083-6ea9-4a3f-9fdc-3e4553c5b7f3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033232 Nov 22 23:11:20.034936 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 656/1329] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:11:20.089470 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7d325ca4-db4e-48dc-98f0-69e024a3ece1 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 204 len: 0 microversion: 2.1 time: 0.142675 Nov 22 23:11:20.090299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 674/1330] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:19 2021] DELETE /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:11:20.104653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:20.105282 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:20.111760 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:20.112341 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:20.113238 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:20.113839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:20.250636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:20.258795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b478e21e-c94e-4c31-81ce-f09884f73daf tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1514 microversion: 2.1 time: 0.158925 Nov 22 23:11:20.259548 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 657/1331] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:20 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:20.375687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:20.377085 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:20.383542 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:20.383999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:20.384798 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:20.385240 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:20.455906 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe1833c77424a2d9ba3d33f1793c9f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4371c64c75764f9c80faa90370720ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:20.464001 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-c84abeac-6a97-49d6-b0d5-5ac6cc5eb595 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 200 len: 1224 microversion: 2.1 time: 0.092466 Nov 22 23:11:20.464718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 675/1332] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:20 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:21.275963 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:21.276569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:21.283186 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:21.283636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:21.284431 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:21.284861 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:21.419593 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:21.427499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fc2f43fd-c67f-402e-9c72-3839a74831c2 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1514 microversion: 2.1 time: 0.155183 Nov 22 23:11:21.428054 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 658/1333] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:21 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:21.481875 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:21.482518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: 2d45b951-a55d-4405-b588-c9a39961ed7e] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:21.489951 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:21.490400 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:21.491188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:21.491625 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:21.505389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] HTTP exception thrown: Instance 2d45b951-a55d-4405-b588-c9a39961ed7e could not be found. Nov 22 23:11:21.506002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Returning 404 to user: Instance 2d45b951-a55d-4405-b588-c9a39961ed7e could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:21.506838 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-6b9d6873-b278-4af2-b45c-7d0af11055d8 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e" status: 404 len: 111 microversion: 2.1 time: 0.029010 Nov 22 23:11:21.507408 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 676/1334] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:21 2021] GET /compute/v2.1/servers/2d45b951-a55d-4405-b588-c9a39961ed7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:21.970372 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:21.971111 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:21.977044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:21.977499 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:21.978384 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:21.978828 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:21.993049 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] HTTP exception thrown: Instance ee39353a-7b66-48b7-b735-20f76c7b3545 could not be found. Nov 22 23:11:21.993651 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Returning 404 to user: Instance ee39353a-7b66-48b7-b735-20f76c7b3545 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:21.994465 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7d21a6c5-aa02-480f-afcc-0e548f3fb4b3 tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 404 len: 111 microversion: 2.1 time: 0.028363 Nov 22 23:11:21.994988 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 659/1335] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:21 2021] DELETE /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:22.003195 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:22.003845 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] [instance: ee39353a-7b66-48b7-b735-20f76c7b3545] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:22.009883 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:22.010335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:22.011114 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:22.011564 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:22.025914 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] HTTP exception thrown: Instance ee39353a-7b66-48b7-b735-20f76c7b3545 could not be found. Nov 22 23:11:22.026523 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Returning 404 to user: Instance ee39353a-7b66-48b7-b735-20f76c7b3545 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:22.027374 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-29190abd-ecc9-4a32-9291-b583411c87fe tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545" status: 404 len: 111 microversion: 2.1 time: 0.028205 Nov 22 23:11:22.027923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 677/1336] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:21 2021] GET /compute/v2.1/servers/ee39353a-7b66-48b7-b735-20f76c7b3545 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:22.444659 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:22.445584 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:22.452079 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:22.452522 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:22.453322 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:22.453932 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:22.649463 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:22.657647 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f3068d26-e5dd-4f89-ae5a-4ce1622fe651 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1514 microversion: 2.1 time: 0.217077 Nov 22 23:11:22.658443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 660/1337] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:22 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:23.028051 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-300825f6-2ef2-4999-8018-b5f3eca2e21a req-a12a586b-c0b4-4aae-91f0-390aab315e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c826379-b173-4887-bf56-92001a040979", "name": "network-vif-deleted", "tag": "431b34e0-b753-44ee-b376-f24909d2b4c5"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:23.030324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:23.030324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:11:23.041321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-300825f6-2ef2-4999-8018-b5f3eca2e21a req-a12a586b-c0b4-4aae-91f0-390aab315e23 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:23.041887 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-300825f6-2ef2-4999-8018-b5f3eca2e21a req-a12a586b-c0b4-4aae-91f0-390aab315e23 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:23.054338 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-300825f6-2ef2-4999-8018-b5f3eca2e21a req-a12a586b-c0b4-4aae-91f0-390aab315e23 service nova] Creating event network-vif-deleted:431b34e0-b753-44ee-b376-f24909d2b4c5 for instance 4c826379-b173-4887-bf56-92001a040979 on hv-cinder-81883 Nov 22 23:11:23.062072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-300825f6-2ef2-4999-8018-b5f3eca2e21a req-a12a586b-c0b4-4aae-91f0-390aab315e23 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037166 Nov 22 23:11:23.062372 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 678/1338] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:23.333648 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5f9a9232-df9f-48da-947f-9034fae5d8df tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] Calling method '.version_select at 0x7fefc9f36e50>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:23.351965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5f9a9232-df9f-48da-947f-9034fae5d8df tempest-TestVolumeBootPattern-2031082835 tempest-TestVolumeBootPattern-2031082835-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-283226992" status: 202 len: 0 microversion: 2.1 time: 0.023919 Nov 22 23:11:23.352705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 661/1339] 10.222.0.81 () {58 vars in 1259 bytes} [Mon Nov 22 23:11:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-283226992 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:11:23.676791 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:23.677499 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:23.683689 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:23.684188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:23.685068 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:23.685556 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:23.724045 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:23.724497 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:23.724955 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lazy-loading 'fault' on Instance uuid 4c826379-b173-4887-bf56-92001a040979 {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:11:23.778454 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:23.786370 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-44b1f4b9-04ef-4f31-9af7-ad4a463d97dc tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 200 len: 1308 microversion: 2.1 time: 0.114947 Nov 22 23:11:23.788356 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 679/1340] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:23 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:24.805690 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:24.806446 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 4c826379-b173-4887-bf56-92001a040979] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:24.812345 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:24.812838 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:24.813594 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:24.814044 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:24.827456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] HTTP exception thrown: Instance 4c826379-b173-4887-bf56-92001a040979 could not be found. Nov 22 23:11:24.828342 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Returning 404 to user: Instance 4c826379-b173-4887-bf56-92001a040979 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:24.829490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cb89f6b7-735c-4545-ba79-30744b5a0b23 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979" status: 404 len: 111 microversion: 2.1 time: 0.028114 Nov 22 23:11:24.830570 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 662/1341] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:24 2021] GET /compute/v2.1/servers/4c826379-b173-4887-bf56-92001a040979 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 23:11:24.838164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:24.838663 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:24.849976 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:24.850998 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:24.851239 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:24.851677 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:24.878320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:24.961177 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-a8d32c15-a2e3-4e4e-8f9c-19b2d2fca7c0 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 204 len: 0 microversion: 2.1 time: 0.125842 Nov 22 23:11:24.962434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 680/1342] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:24 2021] DELETE /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:11:24.970852 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:24.971482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:24.977754 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:24.978203 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:24.979183 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:24.979623 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:25.365366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:25.373381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bc83da76-e8d8-4608-98f8-086b69a625ac tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1514 microversion: 2.1 time: 0.406941 Nov 22 23:11:25.373978 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 663/1343] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:24 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1514 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:26.393602 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:26.394336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:26.400631 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:26.401079 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:26.401912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:26.402345 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:26.552447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:26.560334 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-86f4e749-d4e7-4ad9-8503-7450751e7e04 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1514 microversion: 2.1 time: 0.172078 Nov 22 23:11:26.560881 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 681/1344] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:26 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:27.577564 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:27.578221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:27.584919 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:27.585373 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:27.586395 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:27.586838 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:27.912225 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:27.932717 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-58c16dde-3620-4ad2-915b-d07011b1717e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 200 len: 1514 microversion: 2.1 time: 0.358755 Nov 22 23:11:27.933427 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 664/1345] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:27 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:27.987741 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-00fa4d4c-37c7-47f4-be14-40cdf2d5b7ad req-1ef7526c-ee17-4811-97ec-147b9cc66f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ef14e4-bf9d-41c7-b87e-b674d18f978d", "name": "network-vif-deleted", "tag": "a0c65ea2-dc92-4e3e-884f-d9c2e7233d0d"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:27.990061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:27.990061 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:11:28.046678 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-00fa4d4c-37c7-47f4-be14-40cdf2d5b7ad req-1ef7526c-ee17-4811-97ec-147b9cc66f03 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:28.047222 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-00fa4d4c-37c7-47f4-be14-40cdf2d5b7ad req-1ef7526c-ee17-4811-97ec-147b9cc66f03 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:28.067816 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-00fa4d4c-37c7-47f4-be14-40cdf2d5b7ad req-1ef7526c-ee17-4811-97ec-147b9cc66f03 service nova] Creating event network-vif-deleted:a0c65ea2-dc92-4e3e-884f-d9c2e7233d0d for instance 39ef14e4-bf9d-41c7-b87e-b674d18f978d on hv-cinder-81883 Nov 22 23:11:28.085067 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-00fa4d4c-37c7-47f4-be14-40cdf2d5b7ad req-1ef7526c-ee17-4811-97ec-147b9cc66f03 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092906 Nov 22 23:11:28.086270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 682/1346] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:28.951452 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:28.952105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: 39ef14e4-bf9d-41c7-b87e-b674d18f978d] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:28.958536 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:28.959032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:28.959822 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:28.960269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:28.974093 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] HTTP exception thrown: Instance 39ef14e4-bf9d-41c7-b87e-b674d18f978d could not be found. Nov 22 23:11:28.974688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Returning 404 to user: Instance 39ef14e4-bf9d-41c7-b87e-b674d18f978d could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:28.975529 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bad5a9e3-7047-4512-8061-5e83fe793eb7 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d" status: 404 len: 111 microversion: 2.1 time: 0.027969 Nov 22 23:11:28.976088 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 665/1347] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:28 2021] GET /compute/v2.1/servers/39ef14e4-bf9d-41c7-b87e-b674d18f978d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:30.119808 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:30.120404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:30.127313 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:30.127759 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:30.128533 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:30.128960 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:30.154616 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Going to try to terminate instance {{(pid=116339) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:30.242945 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-40843aee-f226-487b-b22b-95773a886423 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "DELETE /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 204 len: 0 microversion: 2.1 time: 0.126415 Nov 22 23:11:30.248996 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 683/1348] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:30 2021] DELETE /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:11:30.255217 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:30.255970 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:30.264424 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:30.265237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:30.266292 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:30.267514 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:30.467835 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:30.476255 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-508ea885-6fd7-4d32-9c34-c1c9cc8bcf8c tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1513 microversion: 2.1 time: 0.225748 Nov 22 23:11:30.477158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 666/1349] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:30 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:31.495245 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:31.496052 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:31.502649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:31.503098 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:31.503893 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:31.504331 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:31.668750 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:31.677268 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7e3acdcf-03ce-4544-b1db-3024611c194e tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1513 microversion: 2.1 time: 0.185987 Nov 22 23:11:31.677910 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 684/1350] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:31 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:32.694569 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:32.695165 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:32.701705 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:32.702153 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:32.702933 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:32.703366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:32.869658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bac9e407294ed6a9fbf9c26fae51ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a4db5f8dc747ad8dbb2d906029a395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:32.878057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9ce4f00d-021f-4935-bb15-c5257da08152 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 200 len: 1513 microversion: 2.1 time: 0.187047 Nov 22 23:11:32.878629 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 667/1351] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:32 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:11:33.286572 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-a3695142-3a25-4e45-bb03-670973ee750c req-12e70d18-683a-4884-aac0-042520c9640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be176b1b-ac56-4820-828f-d540ef9018f4", "name": "network-vif-deleted", "tag": "ffebb815-24db-4e82-bc2e-25eb4ed18d2e"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:33.288164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:33.288164 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:11:33.295967 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a3695142-3a25-4e45-bb03-670973ee750c req-12e70d18-683a-4884-aac0-042520c9640a service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:33.296395 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-a3695142-3a25-4e45-bb03-670973ee750c req-12e70d18-683a-4884-aac0-042520c9640a service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:33.310359 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-a3695142-3a25-4e45-bb03-670973ee750c req-12e70d18-683a-4884-aac0-042520c9640a service nova] Creating event network-vif-deleted:ffebb815-24db-4e82-bc2e-25eb4ed18d2e for instance be176b1b-ac56-4820-828f-d540ef9018f4 on hv-cinder-81883 Nov 22 23:11:33.315685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-a3695142-3a25-4e45-bb03-670973ee750c req-12e70d18-683a-4884-aac0-042520c9640a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033241 Nov 22 23:11:33.316316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 685/1352] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:33.896896 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:33.897848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] [instance: be176b1b-ac56-4820-828f-d540ef9018f4] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:33.904212 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:33.904665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:33.905443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:33.905910 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:33.919860 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] HTTP exception thrown: Instance be176b1b-ac56-4820-828f-d540ef9018f4 could not be found. Nov 22 23:11:33.920442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] Returning 404 to user: Instance be176b1b-ac56-4820-828f-d540ef9018f4 could not be found. {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:33.921264 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f0386133-ef8e-4727-9621-977382480177 tempest-AttachVolumeNegativeTest-1066276298 tempest-AttachVolumeNegativeTest-1066276298-project] 10.222.0.81 "GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4" status: 404 len: 111 microversion: 2.1 time: 0.028853 Nov 22 23:11:33.921848 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 668/1353] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:33 2021] GET /compute/v2.1/servers/be176b1b-ac56-4820-828f-d540ef9018f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:11:41.842069 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1726094409", "imageRef": "564f0d9e-109c-4644-adc9-71171cb3c88c", "flavorRef": "452"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:41.892948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] validate_networks() for None {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:11:42.171275 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:11:42.171694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:11:42.172168 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:11:42.173008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:11:42.173172 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:11:42.183037 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:42.183515 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:42.184328 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:42.184763 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:42.203601 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Getting quotas for project 3d5e8e8b44ea4502a3bd14baa8002e6b. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:11:42.208580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Getting quotas for user 6caec26cfaf140d7925364954bf615c1 and project 3d5e8e8b44ea4502a3bd14baa8002e6b. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:11:42.219790 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:11:42.222311 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='564f0d9e-109c-4644-adc9-71171cb3c88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:11:42.271858 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1e941ea8-ed18-4a32-bf88-f9c98826a1b3 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434141 Nov 22 23:11:42.272799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 686/1354] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:11:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:11:42.286190 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-45a3092e-c868-4a59-9063-3cb59a392938 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:42.287778 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-45a3092e-c868-4a59-9063-3cb59a392938 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:42.351311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-45a3092e-c868-4a59-9063-3cb59a392938 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:42.359507 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-45a3092e-c868-4a59-9063-3cb59a392938 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1215 microversion: 2.1 time: 0.079049 Nov 22 23:11:42.360577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 669/1355] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:42 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:43.382269 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:43.383713 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:43.394969 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:43.397155 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:43.398363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:43.399072 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:43.487396 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:43.495727 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8d14197a-88e3-4917-9a34-78f2a550789d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1285 microversion: 2.1 time: 0.121505 Nov 22 23:11:43.496949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 687/1356] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:43 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:44.513732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:44.514344 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:44.521773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:44.522533 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:44.523640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:44.524234 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:44.761673 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:44.771119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5ae5ac33-db07-4a5c-83f4-beb40abf123d tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.259979 Nov 22 23:11:44.773767 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 670/1357] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:44 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:44.984861 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-b4104d24-e4e6-4c55-9ba1-3e054195f276 req-018f2184-908a-4dd5-8e7f-1d60f5485fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb", "tag": "8250fc5b-15c8-4aa0-8435-901e03e1af4f"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:44.987723 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:44.987723 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:11:44.997580 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-b4104d24-e4e6-4c55-9ba1-3e054195f276 req-018f2184-908a-4dd5-8e7f-1d60f5485fc7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:44.999244 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-b4104d24-e4e6-4c55-9ba1-3e054195f276 req-018f2184-908a-4dd5-8e7f-1d60f5485fc7 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:45.012479 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-b4104d24-e4e6-4c55-9ba1-3e054195f276 req-018f2184-908a-4dd5-8e7f-1d60f5485fc7 service nova] Creating event network-changed:8250fc5b-15c8-4aa0-8435-901e03e1af4f for instance 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb on hv-cinder-81883 Nov 22 23:11:45.019783 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-b4104d24-e4e6-4c55-9ba1-3e054195f276 req-018f2184-908a-4dd5-8e7f-1d60f5485fc7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039194 Nov 22 23:11:45.023695 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 688/1358] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:45.794032 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:45.794698 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:45.802361 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:45.802824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:45.803636 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:45.804470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:46.018002 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:46.025697 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-2bf0a282-9acb-4086-b36e-403246fb47ce tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.239007 Nov 22 23:11:46.026262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 671/1359] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:45 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:47.044757 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:47.045471 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:47.052234 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:47.052686 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:47.053459 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:47.053921 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:47.199620 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:47.207110 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-834e2744-a043-4b4e-b981-a818dd9910f6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.166772 Nov 22 23:11:47.207687 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 689/1360] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:47 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:48.229251 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:48.229891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:48.236627 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:48.237114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:48.237942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:48.238382 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:48.381482 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:48.389665 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-a0789865-e5d1-4415-9791-73ba2701708f tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.164136 Nov 22 23:11:48.390483 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 672/1361] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:48 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:49.408526 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:49.409224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:49.416184 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:49.416632 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:49.417416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:49.417901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:49.566473 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:49.574092 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-8e0bb942-5396-416a-ac32-dc387d85d404 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.170399 Nov 22 23:11:49.574671 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 690/1362] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:49 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:11:50.508128 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-5056efe0-b323-42eb-b67e-d7652290a409 req-8aa3df26-3852-41cf-bb41-f2be1f53bb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb", "name": "network-vif-plugged", "status": "completed", "tag": "8250fc5b-15c8-4aa0-8435-901e03e1af4f"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:50.514947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:50.514947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:11:50.525343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-5056efe0-b323-42eb-b67e-d7652290a409 req-8aa3df26-3852-41cf-bb41-f2be1f53bb6d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:50.525965 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-5056efe0-b323-42eb-b67e-d7652290a409 req-8aa3df26-3852-41cf-bb41-f2be1f53bb6d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:50.537914 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-5056efe0-b323-42eb-b67e-d7652290a409 req-8aa3df26-3852-41cf-bb41-f2be1f53bb6d service nova] Creating event network-vif-plugged:8250fc5b-15c8-4aa0-8435-901e03e1af4f for instance 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb on hv-cinder-81883 Nov 22 23:11:50.544117 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-5056efe0-b323-42eb-b67e-d7652290a409 req-8aa3df26-3852-41cf-bb41-f2be1f53bb6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044941 Nov 22 23:11:50.544891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 673/1363] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:11:50.592828 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:50.593652 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:50.602163 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:50.602738 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:50.603714 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:50.604445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:50.778493 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:50.791912 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-ae7457c5-476d-4d4a-b6ba-2bbd2d793c68 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.203602 Nov 22 23:11:50.792595 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 691/1364] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:50 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:51.809922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:51.810618 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:51.817329 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:51.817818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:51.818595 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:51.819204 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:51.960031 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:51.967541 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cd17705e-7c58-4c90-aeea-745d04ed0e9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1315 microversion: 2.1 time: 0.161784 Nov 22 23:11:51.968311 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 674/1365] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:51 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:52.984333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:52.985607 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:52.992836 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:52.993301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:52.994103 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:52.994541 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:53.131472 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:53.139577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3907512f-ba6b-4364-9bbe-013a15a73eef tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1464 microversion: 2.1 time: 0.158730 Nov 22 23:11:53.140248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 692/1366] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:52 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:53.178262 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:53.178841 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:53.185306 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:53.185795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:53.186578 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:53.187008 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:53.216007 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:11:53.300246 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-356716fd-ff72-4031-aaf7-1ec669dc45a7 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 204 len: 0 microversion: 2.1 time: 0.125160 Nov 22 23:11:53.301215 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 675/1367] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:11:53 2021] DELETE /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 23:11:53.309675 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:53.310292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:53.316280 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:53.316720 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:53.317489 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:53.317973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:53.535509 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:53.542938 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4ffd1950-da33-446c-b762-6291cda47242 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1470 microversion: 2.1 time: 0.237108 Nov 22 23:11:53.543603 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 693/1368] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:53 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:54.564667 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:54.565647 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:54.575142 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:54.576349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:54.577267 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:54.578349 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:54.714350 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:54.723028 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-00ef147b-3cfe-4f5a-a099-6206f18ff4ba tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1470 microversion: 2.1 time: 0.163719 Nov 22 23:11:54.723620 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 676/1369] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:54 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:55.677386 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-8f539a04-117f-4823-a6cc-8e12e1cf0329 req-1caba744-49b3-4549-be83-d9fc5b12743e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb", "name": "network-vif-deleted", "tag": "8250fc5b-15c8-4aa0-8435-901e03e1af4f"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:11:55.679122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:11:55.679122 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:11:55.686908 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-8f539a04-117f-4823-a6cc-8e12e1cf0329 req-1caba744-49b3-4549-be83-d9fc5b12743e service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:55.687350 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-8f539a04-117f-4823-a6cc-8e12e1cf0329 req-1caba744-49b3-4549-be83-d9fc5b12743e service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:55.700718 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-8f539a04-117f-4823-a6cc-8e12e1cf0329 req-1caba744-49b3-4549-be83-d9fc5b12743e service nova] Creating event network-vif-deleted:8250fc5b-15c8-4aa0-8435-901e03e1af4f for instance 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb on hv-cinder-81883 Nov 22 23:11:55.706528 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-8f539a04-117f-4823-a6cc-8e12e1cf0329 req-1caba744-49b3-4549-be83-d9fc5b12743e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Nov 22 23:11:55.707238 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 694/1370] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:11:55.740400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:55.741684 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:55.747821 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:55.748198 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:55.748981 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:55.749411 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:55.818024 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6caec26cfaf140d7925364954bf615c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5e8e8b44ea4502a3bd14baa8002e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:11:55.825656 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-50740be8-bb85-40d0-b968-12965c450b9b tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 200 len: 1300 microversion: 2.1 time: 0.089014 Nov 22 23:11:55.826231 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 677/1371] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:55 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:11:56.843462 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:11:56.844335 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] [instance: 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:11:56.850667 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:56.851117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:56.851901 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:11:56.852333 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:11:56.865999 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] HTTP exception thrown: Instance 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb could not be found. Nov 22 23:11:56.866592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] Returning 404 to user: Instance 4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:11:56.867415 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fc6036af-73a5-497b-a3e3-6ef2fd5581e6 tempest-VolumesNegativeTest-1668244100 tempest-VolumesNegativeTest-1668244100-project] 10.222.0.81 "GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb" status: 404 len: 111 microversion: 2.1 time: 0.028508 Nov 22 23:11:56.867949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 695/1372] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:11:56 2021] GET /compute/v2.1/servers/4d688e77-89f2-4ad4-a2dd-fef5ec3ef7fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:12:20.825482 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:12:20.826246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:12:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:12:30.844655 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-cd7b8b17-5386-4701-a4d5-fe7e710cbc7f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Action: 'create', calling method: .version_select at 0x7fefc9e498b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1005475238"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:12:30.858439 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-cd7b8b17-5386-4701-a4d5-fe7e710cbc7f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Getting quotas for project 538d6678155f4cee9a60120ca22eab1c. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:12:30.862162 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-cd7b8b17-5386-4701-a4d5-fe7e710cbc7f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Getting quotas for user f3ab83db60ce4c32991ff093fe3a30e7 and project 538d6678155f4cee9a60120ca22eab1c. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:12:31.133057 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-cd7b8b17-5386-4701-a4d5-fe7e710cbc7f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Getting quotas for project 538d6678155f4cee9a60120ca22eab1c. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:12:31.136735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.quota [None req-cd7b8b17-5386-4701-a4d5-fe7e710cbc7f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Getting quotas for user f3ab83db60ce4c32991ff093fe3a30e7 and project 538d6678155f4cee9a60120ca22eab1c. Resources: {'key_pairs'} {{(pid=116338) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:12:31.150445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-cd7b8b17-5386-4701-a4d5-fe7e710cbc7f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.309506 Nov 22 23:12:31.151045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 678/1373] 10.222.0.81 () {60 vars in 1157 bytes} [Mon Nov 22 23:12:30 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:31.199137 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1519203870", "imageRef": "0ef266ce-da9a-48bd-95b8-9e29a6fc5aca", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1005475238", "networks": [{"uuid": "0b3cfe8e-e28b-48b3-b918-5313345f8119"}]}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:12:31.249114 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.network.neutron [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] validate_networks() for [('0b3cfe8e-e28b-48b3-b918-5313345f8119', None, None, None, None, None)] {{(pid=116339) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 23:12:31.617715 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Flavor limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 23:12:31.618143 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Image limits 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 23:12:31.618615 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Flavor pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 23:12:31.619025 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Image pref 0:0:0 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 23:12:31.619439 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.virt.hardware [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 23:12:31.628577 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:31.629023 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:31.629874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:31.630323 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:31.646842 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Getting quotas for project 538d6678155f4cee9a60120ca22eab1c. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 23:12:31.650792 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.quota [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Getting quotas for user f3ab83db60ce4c32991ff093fe3a30e7 and project 538d6678155f4cee9a60120ca22eab1c. Resources: {'instances', 'cores', 'ram'} {{(pid=116339) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 23:12:31.661865 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Going to run 1 instances... {{(pid=116339) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 23:12:31.664126 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ef266ce-da9a-48bd-95b8-9e29a6fc5aca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 23:12:31.711538 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-433d2900-1eaf-46a7-8d10-51183e55a88b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515865 Nov 22 23:12:31.712094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 696/1374] 10.222.0.81 () {60 vars in 1146 bytes} [Mon Nov 22 23:12:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 23:12:31.725470 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-b88dba63-deda-4321-aab7-82a957fb79c2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:31.726124 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-b88dba63-deda-4321-aab7-82a957fb79c2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:31.779496 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-b88dba63-deda-4321-aab7-82a957fb79c2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:31.786830 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-b88dba63-deda-4321-aab7-82a957fb79c2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1259 microversion: 2.1 time: 0.068776 Nov 22 23:12:31.787579 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 679/1375] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:31 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:12:32.803751 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:32.804389 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:32.810864 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:32.811316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:32.812094 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:32.812536 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:32.873794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:32.881457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-dd9d428b-d1f9-463a-81d7-c94d12314f27 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1311 microversion: 2.1 time: 0.081493 Nov 22 23:12:32.882054 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 697/1376] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:32 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1311 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:33.900036 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:33.901263 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:33.909843 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:33.910577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:33.911550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:33.912155 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:34.084376 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:34.091967 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-5125dab9-1dd8-4699-9e43-50f8fe4d3603 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.195634 Nov 22 23:12:34.092813 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 680/1377] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:33 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:35.110161 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:35.110734 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:35.117036 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:35.117479 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:35.118285 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:35.118733 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:35.270155 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:35.277913 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-29cc6fb5-63ef-4c04-979c-d554ce9c2463 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.172081 Nov 22 23:12:35.278513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 698/1378] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:35 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:36.295488 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:36.296099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:36.303537 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:36.304094 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:36.304962 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:36.305405 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:36.453197 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:36.461021 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c7e9643f-9289-46a1-87f0-36f6f731cb80 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.169183 Nov 22 23:12:36.461597 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 681/1379] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:36 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:37.478430 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:37.479295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:37.492961 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:37.493416 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:37.494237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:37.494678 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:37.642270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:37.649924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-01bfd4a6-1284-42d9-82c6-9735f1e3b78f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.175155 Nov 22 23:12:37.650490 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 699/1380] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:37 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:38.667105 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:38.667637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:38.674443 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:38.674894 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:38.675680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:38.676115 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:39.058991 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:39.074002 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-691ba9d8-0377-4bd4-8d6d-7d2fc665fcbb tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.410482 Nov 22 23:12:39.075320 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 682/1381] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:38 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:12:40.091680 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:40.093032 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:40.100413 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:40.101213 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:40.102274 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:40.102971 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:40.238182 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:40.245797 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-45eceef6-3e07-4e48-80cf-82615a0ad6d6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.157640 Nov 22 23:12:40.246367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 700/1382] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:40 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:41.263922 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:41.264508 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:41.271218 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:41.271671 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:41.272457 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:41.272901 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:41.414305 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:41.421986 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-0eb5cfc7-14e7-48cf-960d-c00318586894 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.161625 Nov 22 23:12:41.422911 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 683/1383] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:41 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:42.439701 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:42.440342 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:42.447030 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:42.447480 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:42.448257 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:42.448676 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:42.581773 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:42.589403 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-de66e003-23c9-4f79-b75a-20b5bf98fc2a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.154104 Nov 22 23:12:42.590002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 701/1384] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:42 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:43.606193 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:43.606855 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:43.613333 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:43.613820 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:43.614606 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:43.615045 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:43.742256 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:43.750259 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ecb96a2d-dbaf-47ef-9f03-f04a4c467cf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.146964 Nov 22 23:12:43.750875 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 684/1385] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:43 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:44.767496 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:44.768108 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:44.774288 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:44.774736 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:44.775518 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:44.775954 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:44.908224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:44.915445 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-02320b96-bc67-4469-a75d-10afc57ec48a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.152123 Nov 22 23:12:44.916002 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 702/1386] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:44 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:45.932642 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:45.934040 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:45.941037 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:45.941758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:45.942583 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:45.943020 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:46.154807 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:46.162942 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-c0354fe1-9cfa-413d-a1b3-c21e4c584171 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.234303 Nov 22 23:12:46.163613 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 685/1387] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:45 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:46.241048 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-5178a353-8562-40d5-aba8-a1fe184beda4 req-a97dcb12-a212-4d73-b59a-e24967d7d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:12:46.242958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:12:46.242958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:12:46.255010 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-5178a353-8562-40d5-aba8-a1fe184beda4 req-a97dcb12-a212-4d73-b59a-e24967d7d6f4 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:46.255709 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-5178a353-8562-40d5-aba8-a1fe184beda4 req-a97dcb12-a212-4d73-b59a-e24967d7d6f4 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:46.271167 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-5178a353-8562-40d5-aba8-a1fe184beda4 req-a97dcb12-a212-4d73-b59a-e24967d7d6f4 service nova] Creating event network-changed:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:12:46.276492 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-5178a353-8562-40d5-aba8-a1fe184beda4 req-a97dcb12-a212-4d73-b59a-e24967d7d6f4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040815 Nov 22 23:12:46.277299 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 703/1388] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:12:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:12:47.180712 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:47.181330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:47.189158 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:47.189653 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:47.190456 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:47.190902 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:47.359521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:47.366746 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-54a9e8ab-c1ed-4534-97b8-c7889abb0c84 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.190255 Nov 22 23:12:47.367312 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 686/1389] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:47 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:48.384225 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:48.384919 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:48.391309 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:48.391755 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:48.392524 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:48.392958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:48.524149 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:48.532131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3afee8f1-6a2a-42ac-86ce-48224d3a695d tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.151871 Nov 22 23:12:48.532694 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 704/1390] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:48 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:49.549269 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:49.549917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:49.556190 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:49.556641 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:49.557417 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:49.557889 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:49.691052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:49.698240 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-00d72df9-89ed-40bd-a07a-a21a576701ba tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.153254 Nov 22 23:12:49.698793 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 687/1391] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:49 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:12:50.715261 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:50.716044 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:50.723139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:50.723587 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:50.724358 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:50.724801 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:50.856411 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:50.864483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-fdeb7137-6ef3-46a4-831f-767dd8bd7f51 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.152842 Nov 22 23:12:50.865270 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 705/1392] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:50 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:51.881230 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:51.881910 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:51.888062 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:51.888521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:51.889300 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:51.889892 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:52.022441 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:52.029536 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-283ffbab-37a1-4d7e-94ee-bffe721bc74c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.152101 Nov 22 23:12:52.030132 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 688/1393] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:51 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:52.917130 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-d4126f84-4f2f-46e9-b2a8-92df6bfe56bb req-0c3632ca-54e5-428e-9dd3-9531d9b9d265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "name": "network-vif-plugged", "status": "completed", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:12:52.918671 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:12:52.918671 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:12:52.926731 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-d4126f84-4f2f-46e9-b2a8-92df6bfe56bb req-0c3632ca-54e5-428e-9dd3-9531d9b9d265 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:52.927321 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-d4126f84-4f2f-46e9-b2a8-92df6bfe56bb req-0c3632ca-54e5-428e-9dd3-9531d9b9d265 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:52.939488 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-d4126f84-4f2f-46e9-b2a8-92df6bfe56bb req-0c3632ca-54e5-428e-9dd3-9531d9b9d265 service nova] Creating event network-vif-plugged:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:12:52.944332 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-d4126f84-4f2f-46e9-b2a8-92df6bfe56bb req-0c3632ca-54e5-428e-9dd3-9531d9b9d265 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Nov 22 23:12:52.945096 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 706/1394] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:12:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:12:53.048059 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:53.048657 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:53.055195 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:53.055640 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:53.056414 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:53.056846 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:53.238484 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:53.245799 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-7e2c9342-a1c4-415f-a217-4581ed94bba9 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.201313 Nov 22 23:12:53.246379 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 689/1395] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:53 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:54.265040 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:54.265780 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:54.271985 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:54.272379 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:54.273151 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:54.273586 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:54.409931 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:54.417173 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-96a3b559-fc9d-4d51-b572-e746727689ea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1359 microversion: 2.1 time: 0.156796 Nov 22 23:12:54.417756 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 707/1396] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:54 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:55.434144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:55.434891 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:55.441927 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.442381 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.443166 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.443668 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.575829 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:55.583989 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-37f3d68d-9f71-45f2-bf56-a6cefb895fb6 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1549 microversion: 2.1 time: 0.153522 Nov 22 23:12:55.584557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 690/1397] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:55 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:55.599873 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:55.600613 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:55.606871 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.607314 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.608076 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.608600 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.740565 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:55.747747 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e7be204b-8c01-49f7-8ab0-4f2a4f9d59dd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1549 microversion: 2.1 time: 0.151588 Nov 22 23:12:55.748303 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 708/1398] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:55 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:55.763693 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:55.768071 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:12:55.768071 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:12:55.769052 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:55.769824 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Searching by: {'deleted': False, 'project_id': '538d6678155f4cee9a60120ca22eab1c'} {{(pid=116338) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 22 23:12:55.776494 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.776943 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.777790 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.778226 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.870445 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.multi_cell_list [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116338) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 22 23:12:55.960257 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-58d40815-4c5b-4752-a698-d7f8d095e8ec tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200035 Nov 22 23:12:55.960735 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 691/1399] 10.222.0.81 () {58 vars in 1124 bytes} [Mon Nov 22 23:12:55 2021] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:12:55.970578 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:12:55.971188 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:55.976973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.977420 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:55.978233 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:55.978673 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:56.107160 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:12:56.115017 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-73edc1e0-271e-41e3-93a8-e82ed6b207f5 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1549 microversion: 2.1 time: 0.148070 Nov 22 23:12:56.115638 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 709/1400] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:12:55 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:12:57.608089 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b53a17-03b8-4b91-9179-6222d4d542e4"}} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:12:57.609730 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:12:57.616516 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:57.616968 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:57.617794 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:12:57.618231 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:12:57.898980 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3fbd7fa6-72e2-4335-aa00-160797aa0749 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294579 Nov 22 23:12:57.899611 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 692/1401] 10.222.0.81 () {60 vars in 1322 bytes} [Mon Nov 22 23:12:57 2021] POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:13:05.417949 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:13:05.418643 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:13:05.425910 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:05.426619 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:05.427407 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:05.427847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:05.562324 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:13:05.570073 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-1f0e444b-4368-4cf9-a94f-641cec03d596 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1595 microversion: 2.1 time: 0.155804 Nov 22 23:13:05.570637 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 710/1402] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:13:05 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:13:07.265426 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-6e353030-d2a5-4308-a767-974f40b8834b req-48596b50-81c4-47ac-a380-1c9a67044f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:13:07.273043 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:13:07.273043 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:13:07.282635 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-6e353030-d2a5-4308-a767-974f40b8834b req-48596b50-81c4-47ac-a380-1c9a67044f2d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:07.283062 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-6e353030-d2a5-4308-a767-974f40b8834b req-48596b50-81c4-47ac-a380-1c9a67044f2d service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:07.296290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-6e353030-d2a5-4308-a767-974f40b8834b req-48596b50-81c4-47ac-a380-1c9a67044f2d service nova] Creating event network-changed:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:13:07.301847 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-6e353030-d2a5-4308-a767-974f40b8834b req-48596b50-81c4-47ac-a380-1c9a67044f2d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040901 Nov 22 23:13:07.305501 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 693/1403] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:13:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:13:08.446175 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1255715482"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:13:08.446799 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:13:08.453923 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:08.454447 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:08.455295 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:08.455794 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:08.595434 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.network.security_group_api [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Adding security group 447ec443-9992-4ff0-8533-eda4fb1247f7 to port 5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb Nov 22 23:13:09.170336 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-15e6716c-ca8c-46db-961d-06dcf8884bcd tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/action" status: 202 len: 0 microversion: 2.1 time: 0.727943 Nov 22 23:13:09.172242 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 711/1404] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:13:08 2021] POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:13:09.186070 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:13:09.187437 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:13:09.196217 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:09.196884 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:09.197806 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:09.207192 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:09.317485 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-220e755b-f6e6-47a5-b8fe-80a957e26786 req-513c6c52-a965-448e-89ab-128c94a88ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:13:09.319292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:13:09.319292 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:13:09.327487 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-220e755b-f6e6-47a5-b8fe-80a957e26786 req-513c6c52-a965-448e-89ab-128c94a88ded service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:13:09.327966 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-220e755b-f6e6-47a5-b8fe-80a957e26786 req-513c6c52-a965-448e-89ab-128c94a88ded service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:13:09.349008 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-220e755b-f6e6-47a5-b8fe-80a957e26786 req-513c6c52-a965-448e-89ab-128c94a88ded service nova] Creating event network-changed:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:13:09.355231 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-220e755b-f6e6-47a5-b8fe-80a957e26786 req-513c6c52-a965-448e-89ab-128c94a88ded service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040855 Nov 22 23:13:09.356847 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 712/1405] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:13:09.387658 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:13:09.397567 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-6985512b-5544-4f8c-a7b8-9a8781113bf3 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1759 microversion: 2.1 time: 0.220480 Nov 22 23:13:09.402144 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 694/1406] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:13:09 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1759 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:09.855363 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:14:09.856424 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:09.862864 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:09.863305 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:09.864081 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:09.864513 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:09.943820 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-3c1ee25f-f739-44ea-a7cc-814281a4628e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/action" status: 202 len: 0 microversion: 2.1 time: 0.093358 Nov 22 23:14:09.944450 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 713/1407] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:14:09 2021] POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:14:09.954358 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:09.955080 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:09.961119 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:09.961738 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:09.962672 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:09.963114 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:10.357343 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:10.369245 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-9b180561-c43d-46db-b2f4-dcd2584e9161 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1751 microversion: 2.1 time: 0.420035 Nov 22 23:14:10.370336 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 695/1408] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:09 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1751 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:14:11.393077 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:11.393812 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:11.400224 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:11.400674 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:11.401457 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:11.401929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:11.601752 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:11.611883 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-de863bfb-cc3b-4bd8-ab2b-1ea0c916ec06 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.224154 Nov 22 23:14:11.612464 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 714/1409] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:11 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:14:12.630576 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:12.631188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:12.638519 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:12.639297 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:12.640101 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:12.640539 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:12.862042 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:12.870164 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-846d720c-3c16-499b-ab4f-0356cb5c3cfe tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.243584 Nov 22 23:14:12.872961 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 696/1410] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:12 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:13.891367 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:13.891978 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:13.898401 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:13.898848 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:13.899635 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:13.900074 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:14.050128 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:14.057948 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-f4b148a7-2121-4794-bb7f-f3b8257f4835 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.170248 Nov 22 23:14:14.058512 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 715/1411] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:13 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:15.076549 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:15.077145 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:15.083625 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:15.084082 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:15.084867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:15.085307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:15.230188 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:15.238124 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ea1ee7df-1ed3-4fe2-8010-21921a423cf2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.165796 Nov 22 23:14:15.238694 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 697/1412] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:15 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 23:14:16.255973 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:16.256520 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:16.263109 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:16.263750 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:16.264591 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:16.265031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:16.411380 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:16.420026 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-5548404e-86d2-485b-87f9-52ba1f94c82b tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.167578 Nov 22 23:14:16.420616 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 716/1413] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:16 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:17.446034 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:17.446637 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:17.454127 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:17.454577 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:17.455366 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:17.455867 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:17.600357 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:17.608947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-aa61103e-f3c6-49b1-a323-91be2fe35a5c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.166618 Nov 22 23:14:17.609505 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 698/1414] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:17 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:18.625592 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:18.626214 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:18.632376 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:18.632826 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:18.633605 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:18.634066 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:18.781365 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:18.789278 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e2a5bb12-a0c7-405c-b99c-dfeeb70e2c6e tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.167857 Nov 22 23:14:18.789874 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 717/1415] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:18 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:19.806169 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:19.806795 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:19.813490 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:19.813968 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:19.814748 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:19.815179 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:19.964375 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:19.974732 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-45004205-70eb-4ea7-9a91-7d45fbc57be2 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.172128 Nov 22 23:14:19.975307 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 699/1416] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:19 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:20.992958 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:20.993543 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:21.000050 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:21.000494 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:21.001256 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:21.001721 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:21.143039 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:21.150940 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-cc5ba4ed-6b0e-4559-8130-aabdc6a30562 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1756 microversion: 2.1 time: 0.161608 Nov 22 23:14:21.151529 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 718/1417] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:20 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:14:22.168538 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:14:22.169143 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:14:22.175099 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:22.175550 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:22.176327 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:14:22.176758 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:14:22.326400 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:14:22.334124 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-fbe9dcf1-e526-4ccb-9114-19ed7bab3b6f tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1759 microversion: 2.1 time: 0.169662 Nov 22 23:14:22.334688 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 700/1418] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:14:22 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:15:25.595422 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1255715482"}} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:15:25.596131 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:25.601974 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:25.602419 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:25.603248 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:25.603683 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:25.734087 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.network.security_group_api [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Removing security group 447ec443-9992-4ff0-8533-eda4fb1247f7 from port 5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb Nov 22 23:15:26.067316 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7d6db9e3-541e-47ec-9599-d0091149f219 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/action" status: 202 len: 0 microversion: 2.1 time: 0.476510 Nov 22 23:15:26.072046 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 719/1419] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Nov 22 23:15:25 2021] POST /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:15:26.085152 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:15:26.086886 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:15:26.086886 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:15:26.096276 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:26.097176 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:26.135557 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] Creating event network-changed:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:15:26.143681 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: ERROR oslo.messaging._drivers.impl_rabbit [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] [db9ee81e-ad8e-4b60-986c-0d574bbcc936] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 23:15:27.161676 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] [db9ee81e-ad8e-4b60-986c-0d574bbcc936] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 43116. Nov 22 23:15:27.165005 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-b8747112-a571-4a04-b18b-e61527593800 req-610ab099-4b60-4c92-ad1b-7e55689531e6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.089884 Nov 22 23:15:27.165643 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 701/1420] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:15:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:15:27.420377 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:27.420929 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:27.427944 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:27.428481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:27.429979 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:27.430491 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:27.510649 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.objects.instance [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lazy-loading 'services' on Instance uuid 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 {{(pid=116339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 23:15:27.588369 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4abc6185-c0f0-4874-8168-c3449be12021 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "DELETE /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments/99b53a17-03b8-4b91-9179-6222d4d542e4" status: 202 len: 0 microversion: 2.1 time: 0.172049 Nov 22 23:15:27.589246 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 720/1421] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:15:27 2021] DELETE /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments/99b53a17-03b8-4b91-9179-6222d4d542e4 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:15:27.597917 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:27.599009 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:27.606185 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:27.606721 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:27.607515 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:27.607947 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:27.640074 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-ba6da3c6-19b5-483b-a022-6876cd694495 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Nov 22 23:15:27.643983 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 702/1422] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:15:27 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:15:28.652320 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:28.653483 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:28.659924 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:28.660370 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:28.661139 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:28.661587 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:28.690503 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-353c40be-dda7-45e7-bc12-a27ed8249e59 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043322 Nov 22 23:15:28.691055 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 721/1423] 10.222.0.81 () {58 vars in 1301 bytes} [Mon Nov 22 23:15:28 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 23:15:28.700865 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:28.701369 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:28.707812 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:28.708186 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:28.708985 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:28.709413 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:28.781060 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.wsgi [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] HTTP exception thrown: Instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 is not attached to volume 99b53a17-03b8-4b91-9179-6222d4d542e4 Nov 22 23:15:28.781669 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Returning 404 to user: Instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 is not attached to volume 99b53a17-03b8-4b91-9179-6222d4d542e4 {{(pid=116338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:15:28.782489 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-3fe4918c-7bbd-45a9-86c6-06cdf8669bea tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "DELETE /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments/99b53a17-03b8-4b91-9179-6222d4d542e4" status: 404 len: 154 microversion: 2.1 time: 0.085611 Nov 22 23:15:28.783023 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 703/1424] 10.222.0.81 () {58 vars in 1415 bytes} [Mon Nov 22 23:15:28 2021] DELETE /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5/os-volume_attachments/99b53a17-03b8-4b91-9179-6222d4d542e4 => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:15:29.330843 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [req-d64fbebc-06a8-45df-bc3a-d15e40e6e8f5 req-6207171c-802c-440b-8c35-676f287c1666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:15:29.332322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:15:29.332322 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: warnings.warn(msg) Nov 22 23:15:29.339237 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-d64fbebc-06a8-45df-bc3a-d15e40e6e8f5 req-6207171c-802c-440b-8c35-676f287c1666 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:29.339686 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [req-d64fbebc-06a8-45df-bc3a-d15e40e6e8f5 req-6207171c-802c-440b-8c35-676f287c1666 service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:29.350397 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.compute.server_external_events [req-d64fbebc-06a8-45df-bc3a-d15e40e6e8f5 req-6207171c-802c-440b-8c35-676f287c1666 service nova] Creating event network-changed:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:15:29.355735 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [req-d64fbebc-06a8-45df-bc3a-d15e40e6e8f5 req-6207171c-802c-440b-8c35-676f287c1666 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028491 Nov 22 23:15:29.356310 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 722/1425] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:15:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 23:15:29.910140 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:29.910691 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:29.918609 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:29.919055 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:29.919872 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:29.920498 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:29.947237 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Going to try to terminate instance {{(pid=116338) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 23:15:30.020680 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-bdd0cd4a-c45e-4667-be3e-4b0ceb7eb020 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "DELETE /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 204 len: 0 microversion: 2.1 time: 0.113795 Nov 22 23:15:30.021430 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 704/1426] 10.222.0.81 () {58 vars in 1238 bytes} [Mon Nov 22 23:15:29 2021] DELETE /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 23:15:30.031708 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:30.032404 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:30.038481 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:30.038930 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:30.039698 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:30.040132 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:30.171706 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:15:30.179117 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-7ae1e20f-95b2-4225-8123-8aab6738810c tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1555 microversion: 2.1 time: 0.152889 Nov 22 23:15:30.179681 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 723/1427] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:15:30 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:15:31.197818 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:31.198847 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.compute.api [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116338) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:31.205221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:31.205697 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:31.206471 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:31.206906 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:31.344084 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.policy [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116338) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:15:31.351433 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-f493e126-7092-4a3c-94b7-58a81cc1712a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1555 microversion: 2.1 time: 0.157693 Nov 22 23:15:31.351999 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 705/1428] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:15:31 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:15:32.369540 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:32.370927 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:32.377378 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:32.377946 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:32.378743 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:32.379179 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:32.623300 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.policy [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ab83db60ce4c32991ff093fe3a30e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538d6678155f4cee9a60120ca22eab1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116339) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 23:15:32.630330 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [req-a61c79d8-4e1d-47c9-b049-ccf699aa6c3b req-57508227-423e-48b0-9f4b-034c14117c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5", "name": "network-vif-deleted", "tag": "5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb"}]} {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 23:15:32.632562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 23:15:32.632562 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: warnings.warn(msg) Nov 22 23:15:32.633031 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-e4efa778-f08f-45dc-946f-7f64fd858922 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 200 len: 1555 microversion: 2.1 time: 0.267184 Nov 22 23:15:32.633652 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 724/1429] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:15:32 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 1555 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 23:15:32.640759 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-a61c79d8-4e1d-47c9-b049-ccf699aa6c3b req-57508227-423e-48b0-9f4b-034c14117c1b service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:32.641236 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG oslo_concurrency.lockutils [req-a61c79d8-4e1d-47c9-b049-ccf699aa6c3b req-57508227-423e-48b0-9f4b-034c14117c1b service nova] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:32.652310 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.compute.server_external_events [req-a61c79d8-4e1d-47c9-b049-ccf699aa6c3b req-57508227-423e-48b0-9f4b-034c14117c1b service nova] Creating event network-vif-deleted:5ae4fa61-a811-41d2-83c5-1d4ed4ecaadb for instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 on hv-cinder-81883 Nov 22 23:15:32.657442 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [req-a61c79d8-4e1d-47c9-b049-ccf699aa6c3b req-57508227-423e-48b0-9f4b-034c14117c1b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030654 Nov 22 23:15:32.658176 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 706/1430] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Nov 22 23:15:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 23:15:33.208290 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:15:33.208521 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:15:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:15:33.649871 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '>' {{(pid=116339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:33.650508 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.compute.api [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [instance: 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5] Fetching instance by UUID {{(pid=116339) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 23:15:33.658091 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:33.658534 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:33.659301 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 23:15:33.659732 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG oslo_concurrency.lockutils [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Lock "76bf02e0-29a2-4545-b6a3-dd98a1461c4d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 23:15:33.672730 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.wsgi [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] HTTP exception thrown: Instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 could not be found. Nov 22 23:15:33.673307 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: DEBUG nova.api.openstack.wsgi [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Returning 404 to user: Instance 49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 could not be found. {{(pid=116339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 23:15:33.674146 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO nova.api.openstack.requestlog [None req-4e27f7a5-0272-408e-a1fc-421199a4a15a tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5" status: 404 len: 111 microversion: 2.1 time: 0.027970 Nov 22 23:15:33.674672 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: [pid: 116339|app: 0|req: 725/1431] 10.222.0.81 () {58 vars in 1235 bytes} [Mon Nov 22 23:15:33 2021] GET /compute/v2.1/servers/49a8a8a4-feb3-4b2e-ab66-abf3bfed37e5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 23:15:33.683786 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: DEBUG nova.api.openstack.wsgi [None req-005b0824-32f7-47ab-9a52-e1942c95b997 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] Calling method '.version_select at 0x7fefca11e430>' {{(pid=116338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 23:15:33.686925 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: ERROR oslo.messaging._drivers.impl_rabbit [None req-005b0824-32f7-47ab-9a52-e1942c95b997 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [3a5debb3-bce5-4de9-9d29-da900600ed61] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 23:15:34.702853 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [None req-005b0824-32f7-47ab-9a52-e1942c95b997 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] [3a5debb3-bce5-4de9-9d29-da900600ed61] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 43162. Nov 22 23:15:34.722383 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO nova.api.openstack.requestlog [None req-005b0824-32f7-47ab-9a52-e1942c95b997 tempest-TestMinimumBasicScenario-2118288254 tempest-TestMinimumBasicScenario-2118288254-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1005475238" status: 202 len: 0 microversion: 2.1 time: 1.043037 Nov 22 23:15:34.723221 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: [pid: 116338|app: 0|req: 707/1432] 10.222.0.81 () {58 vars in 1271 bytes} [Mon Nov 22 23:15:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1005475238 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 23:15:40.855685 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:15:40.856243 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:15:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:15:49.254939 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:15:49.255646 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:15:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:18:53.226954 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:18:53.227839 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:18:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:19:00.875124 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:19:00.875645 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:19:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:19:09.273047 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:19:09.273707 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:19:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:20:37.329316 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:20:37.329979 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:20:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:20:53.648596 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:20:53.649254 dv-cinder-818834-1-iscsi devstack@n-api.service[116339]: Mon Nov 22 23:20:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 23:20:57.152773 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 23:20:57.153388 dv-cinder-818834-1-iscsi devstack@n-api.service[116338]: Mon Nov 22 23:20:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!